2023-07-18 18:10:10,292 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-18 18:10:10,536 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a 2023-07-18 18:10:10,537 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-18 18:10:10,584 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-18 18:10:10,826 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-18 18:10:10,827 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1, deleteOnExit=true 2023-07-18 18:10:10,827 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-18 18:10:10,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/test.cache.data in system properties and HBase conf 2023-07-18 18:10:10,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:10:10,829 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:10:10,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:10:10,830 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:10:10,830 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:10:11,191 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-18 18:10:11,199 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:11,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:11,200 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:10:11,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:11,201 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:10:11,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:10:11,202 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:11,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:11,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:10:11,203 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:10:11,204 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:10:11,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:11,205 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:10:11,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-18 18:10:11,836 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:10:11,841 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:10:12,213 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-18 18:10:12,407 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-18 18:10:12,420 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:12,467 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:12,509 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_localhost_43403_hdfs____.fj124e/webapp 2023-07-18 18:10:12,651 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43403 2023-07-18 18:10:12,708 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-18 18:10:12,708 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-18 18:10:13,216 WARN [Listener at localhost/43971] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:13,304 WARN [Listener at localhost/43971] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:10:13,330 WARN [Listener at localhost/43971] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:13,339 INFO [Listener at localhost/43971] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:13,346 INFO [Listener at localhost/43971] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_localhost_37203_datanode____.x1cloo/webapp 2023-07-18 18:10:13,482 INFO [Listener at localhost/43971] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37203 2023-07-18 18:10:14,014 WARN [Listener at localhost/37925] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:14,071 WARN [Listener at localhost/37925] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:10:14,079 WARN [Listener at localhost/37925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:14,080 INFO [Listener at localhost/37925] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:14,088 INFO [Listener at localhost/37925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_localhost_38219_datanode____.7xat6s/webapp 2023-07-18 18:10:14,208 INFO [Listener at localhost/37925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38219 2023-07-18 18:10:14,239 WARN [Listener at localhost/33015] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:14,305 WARN [Listener at localhost/33015] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-18 18:10:14,313 WARN [Listener at localhost/33015] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:14,315 INFO [Listener at localhost/33015] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:14,322 INFO [Listener at localhost/33015] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_localhost_37469_datanode____8ksgoq/webapp 2023-07-18 18:10:14,487 INFO [Listener at localhost/33015] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37469 2023-07-18 18:10:14,531 WARN [Listener at localhost/36595] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-18 18:10:14,764 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc97053ebcde3b0d3: Processing first storage report for DS-723677ff-b9df-4785-8206-f010d441233c from datanode 91a6329d-2b60-4984-a2d0-4b652011e923 2023-07-18 18:10:14,766 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc97053ebcde3b0d3: from storage DS-723677ff-b9df-4785-8206-f010d441233c node DatanodeRegistration(127.0.0.1:42831, datanodeUuid=91a6329d-2b60-4984-a2d0-4b652011e923, infoPort=41533, infoSecurePort=0, ipcPort=36595, storageInfo=lv=-57;cid=testClusterID;nsid=671729366;c=1689703811913), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,766 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe2d2e40b608c8258: Processing first storage report for DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c from datanode 6150c56b-8cab-4f7f-b94b-36850696fcc5 2023-07-18 18:10:14,766 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe2d2e40b608c8258: from storage DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c node DatanodeRegistration(127.0.0.1:34477, datanodeUuid=6150c56b-8cab-4f7f-b94b-36850696fcc5, infoPort=41539, infoSecurePort=0, ipcPort=37925, storageInfo=lv=-57;cid=testClusterID;nsid=671729366;c=1689703811913), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,766 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf08476d1bf5c4d58: Processing first storage report for DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d from datanode 24d90ede-13d7-426e-8649-48aa06e7553b 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf08476d1bf5c4d58: from storage DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d node DatanodeRegistration(127.0.0.1:34733, datanodeUuid=24d90ede-13d7-426e-8649-48aa06e7553b, infoPort=35381, infoSecurePort=0, ipcPort=33015, storageInfo=lv=-57;cid=testClusterID;nsid=671729366;c=1689703811913), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc97053ebcde3b0d3: Processing first storage report for DS-e7e29ddd-3724-4a71-98df-4bfa5b91ada4 from datanode 91a6329d-2b60-4984-a2d0-4b652011e923 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc97053ebcde3b0d3: from storage DS-e7e29ddd-3724-4a71-98df-4bfa5b91ada4 node DatanodeRegistration(127.0.0.1:42831, datanodeUuid=91a6329d-2b60-4984-a2d0-4b652011e923, infoPort=41533, infoSecurePort=0, ipcPort=36595, storageInfo=lv=-57;cid=testClusterID;nsid=671729366;c=1689703811913), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe2d2e40b608c8258: Processing first storage report for DS-b592fff9-a8e5-4860-a625-4486f37e78c1 from datanode 6150c56b-8cab-4f7f-b94b-36850696fcc5 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe2d2e40b608c8258: from storage DS-b592fff9-a8e5-4860-a625-4486f37e78c1 node DatanodeRegistration(127.0.0.1:34477, datanodeUuid=6150c56b-8cab-4f7f-b94b-36850696fcc5, infoPort=41539, infoSecurePort=0, ipcPort=37925, storageInfo=lv=-57;cid=testClusterID;nsid=671729366;c=1689703811913), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf08476d1bf5c4d58: Processing first storage report for DS-6865eaa1-6308-4958-a3c9-bae38d42c023 from datanode 24d90ede-13d7-426e-8649-48aa06e7553b 2023-07-18 18:10:14,767 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf08476d1bf5c4d58: from storage DS-6865eaa1-6308-4958-a3c9-bae38d42c023 node DatanodeRegistration(127.0.0.1:34733, datanodeUuid=24d90ede-13d7-426e-8649-48aa06e7553b, infoPort=35381, infoSecurePort=0, ipcPort=33015, storageInfo=lv=-57;cid=testClusterID;nsid=671729366;c=1689703811913), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-18 18:10:14,977 DEBUG [Listener at localhost/36595] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a 2023-07-18 18:10:15,080 INFO [Listener at localhost/36595] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/zookeeper_0, clientPort=55531, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-18 18:10:15,102 INFO [Listener at localhost/36595] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55531 2023-07-18 18:10:15,115 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:15,118 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:15,809 INFO [Listener at localhost/36595] util.FSUtils(471): Created version file at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 with version=8 2023-07-18 18:10:15,809 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/hbase-staging 2023-07-18 18:10:16,165 INFO [Listener at localhost/36595] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-18 18:10:16,766 INFO [Listener at localhost/36595] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:16,804 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:16,805 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:16,805 INFO [Listener at localhost/36595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:16,805 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:16,806 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:16,971 INFO [Listener at localhost/36595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,053 DEBUG [Listener at localhost/36595] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-18 18:10:17,169 INFO [Listener at localhost/36595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41889 2023-07-18 18:10:17,184 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,186 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,212 INFO [Listener at localhost/36595] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41889 connecting to ZooKeeper ensemble=127.0.0.1:55531 2023-07-18 18:10:17,266 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:418890x0, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41889-0x10179a09a920000 connected 2023-07-18 18:10:17,315 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,316 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,332 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,341 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41889 2023-07-18 18:10:17,342 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41889 2023-07-18 18:10:17,342 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41889 2023-07-18 18:10:17,345 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41889 2023-07-18 18:10:17,346 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41889 2023-07-18 18:10:17,354 INFO [Listener at localhost/36595] master.HMaster(444): hbase.rootdir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, hbase.cluster.distributed=false 2023-07-18 18:10:17,432 INFO [Listener at localhost/36595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:17,432 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,433 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,433 INFO [Listener at localhost/36595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:17,433 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,433 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:17,438 INFO [Listener at localhost/36595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,441 INFO [Listener at localhost/36595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39363 2023-07-18 18:10:17,443 INFO [Listener at localhost/36595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:10:17,451 DEBUG [Listener at localhost/36595] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:10:17,452 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,454 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,456 INFO [Listener at localhost/36595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39363 connecting to ZooKeeper ensemble=127.0.0.1:55531 2023-07-18 18:10:17,542 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:393630x0, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39363-0x10179a09a920001 connected 2023-07-18 18:10:17,544 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,546 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,547 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,551 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39363 2023-07-18 18:10:17,552 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39363 2023-07-18 18:10:17,552 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39363 2023-07-18 18:10:17,554 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39363 2023-07-18 18:10:17,555 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39363 2023-07-18 18:10:17,569 INFO [Listener at localhost/36595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:17,569 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,569 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,570 INFO [Listener at localhost/36595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:17,570 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,570 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:17,570 INFO [Listener at localhost/36595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,574 INFO [Listener at localhost/36595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33749 2023-07-18 18:10:17,575 INFO [Listener at localhost/36595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:10:17,579 DEBUG [Listener at localhost/36595] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:10:17,580 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,583 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,586 INFO [Listener at localhost/36595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33749 connecting to ZooKeeper ensemble=127.0.0.1:55531 2023-07-18 18:10:17,665 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:337490x0, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,667 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:337490x0, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33749-0x10179a09a920002 connected 2023-07-18 18:10:17,668 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,670 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,670 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33749 2023-07-18 18:10:17,673 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33749 2023-07-18 18:10:17,680 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33749 2023-07-18 18:10:17,682 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33749 2023-07-18 18:10:17,687 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33749 2023-07-18 18:10:17,702 INFO [Listener at localhost/36595] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-18 18:10:17,703 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,703 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,703 INFO [Listener at localhost/36595] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-18 18:10:17,703 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-18 18:10:17,704 INFO [Listener at localhost/36595] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-18 18:10:17,704 INFO [Listener at localhost/36595] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-18 18:10:17,707 INFO [Listener at localhost/36595] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38743 2023-07-18 18:10:17,708 INFO [Listener at localhost/36595] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-18 18:10:17,716 DEBUG [Listener at localhost/36595] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-18 18:10:17,717 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,720 INFO [Listener at localhost/36595] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:17,721 INFO [Listener at localhost/36595] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38743 connecting to ZooKeeper ensemble=127.0.0.1:55531 2023-07-18 18:10:17,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:387430x0, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-18 18:10:17,820 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:387430x0, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:10:17,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38743-0x10179a09a920003 connected 2023-07-18 18:10:17,821 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:10:17,822 DEBUG [Listener at localhost/36595] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-18 18:10:17,823 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38743 2023-07-18 18:10:17,823 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38743 2023-07-18 18:10:17,824 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38743 2023-07-18 18:10:17,824 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38743 2023-07-18 18:10:17,824 DEBUG [Listener at localhost/36595] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38743 2023-07-18 18:10:17,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:17,943 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:10:17,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:18,051 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:18,051 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:18,052 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:18,051 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:18,051 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-18 18:10:18,053 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:10:18,055 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41889,1689703815990 from backup master directory 2023-07-18 18:10:18,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-18 18:10:18,143 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:18,143 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-18 18:10:18,144 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:18,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:18,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-18 18:10:18,151 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-18 18:10:18,279 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/hbase.id with ID: c761efd0-5473-419f-b731-dc3c3ae07920 2023-07-18 18:10:18,397 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-18 18:10:18,488 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:18,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x33e9ed81 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:18,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@26b7de24, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:18,780 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:18,782 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-18 18:10:18,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-18 18:10:18,801 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-18 18:10:18,803 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:10:18,808 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:10:18,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:18,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store-tmp 2023-07-18 18:10:18,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:18,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:10:18,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:10:18,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:10:18,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:10:18,895 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/WALs/jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:18,919 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41889%2C1689703815990, suffix=, logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/WALs/jenkins-hbase4.apache.org,41889,1689703815990, archiveDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/oldWALs, maxLogs=10 2023-07-18 18:10:18,977 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK] 2023-07-18 18:10:18,977 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK] 2023-07-18 18:10:18,977 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK] 2023-07-18 18:10:18,986 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-18 18:10:19,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/WALs/jenkins-hbase4.apache.org,41889,1689703815990/jenkins-hbase4.apache.org%2C41889%2C1689703815990.1689703818930 2023-07-18 18:10:19,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK], DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK]] 2023-07-18 18:10:19,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:19,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:19,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,081 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,158 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,166 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-18 18:10:19,203 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-18 18:10:19,220 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:19,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-18 18:10:19,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:19,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67963771, jitterRate=0.012739107012748718}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:19,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:10:19,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-18 18:10:19,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-18 18:10:19,290 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-18 18:10:19,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-18 18:10:19,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-18 18:10:19,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-18 18:10:19,350 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-18 18:10:19,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-18 18:10:19,391 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-18 18:10:19,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-18 18:10:19,435 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-18 18:10:19,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-18 18:10:19,446 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-18 18:10:19,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-18 18:10:19,454 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-18 18:10:19,457 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-18 18:10:19,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-18 18:10:19,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-18 18:10:19,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,485 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41889,1689703815990, sessionid=0x10179a09a920000, setting cluster-up flag (Was=false) 2023-07-18 18:10:19,503 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-18 18:10:19,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:19,520 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:19,526 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-18 18:10:19,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:19,530 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp 2023-07-18 18:10:19,634 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(951): ClusterId : c761efd0-5473-419f-b731-dc3c3ae07920 2023-07-18 18:10:19,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-18 18:10:19,636 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(951): ClusterId : c761efd0-5473-419f-b731-dc3c3ae07920 2023-07-18 18:10:19,645 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(951): ClusterId : c761efd0-5473-419f-b731-dc3c3ae07920 2023-07-18 18:10:19,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-18 18:10:19,652 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:10:19,654 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:10:19,654 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-18 18:10:19,661 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:10:19,661 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:10:19,661 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-18 18:10:19,662 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:10:19,661 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:10:19,662 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-18 18:10:19,667 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:10:19,667 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:10:19,669 DEBUG [RS:2;jenkins-hbase4:38743] zookeeper.ReadOnlyZKClient(139): Connect 0x5764687d to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:19,669 DEBUG [RS:1;jenkins-hbase4:33749] zookeeper.ReadOnlyZKClient(139): Connect 0x39b14ca9 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:19,676 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-18 18:10:19,695 DEBUG [RS:0;jenkins-hbase4:39363] zookeeper.ReadOnlyZKClient(139): Connect 0x668f84dc to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:19,723 DEBUG [RS:2;jenkins-hbase4:38743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a1d730d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:19,724 DEBUG [RS:2;jenkins-hbase4:38743] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ce9a01e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:10:19,725 DEBUG [RS:0;jenkins-hbase4:39363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55269b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:19,725 DEBUG [RS:0;jenkins-hbase4:39363] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56876f3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:10:19,729 DEBUG [RS:1;jenkins-hbase4:33749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb3d5fb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:19,729 DEBUG [RS:1;jenkins-hbase4:33749] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d05ed93, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:10:19,759 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39363 2023-07-18 18:10:19,759 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33749 2023-07-18 18:10:19,770 INFO [RS:0;jenkins-hbase4:39363] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:10:19,788 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:38743 2023-07-18 18:10:19,770 INFO [RS:1;jenkins-hbase4:33749] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:10:19,788 INFO [RS:1;jenkins-hbase4:33749] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:10:19,788 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 18:10:19,788 INFO [RS:0;jenkins-hbase4:39363] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:10:19,791 INFO [RS:2;jenkins-hbase4:38743] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-18 18:10:19,791 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 18:10:19,791 INFO [RS:2;jenkins-hbase4:38743] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-18 18:10:19,789 INFO [RS:1;jenkins-hbase4:33749] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,791 INFO [RS:0;jenkins-hbase4:39363] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,791 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:10:19,791 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:10:19,791 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-18 18:10:19,792 INFO [RS:2;jenkins-hbase4:38743] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:19,792 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1022): About to register with Master. 2023-07-18 18:10:19,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-18 18:10:19,794 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41889,1689703815990 with isa=jenkins-hbase4.apache.org/172.31.14.131:38743, startcode=1689703817702 2023-07-18 18:10:19,794 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41889,1689703815990 with isa=jenkins-hbase4.apache.org/172.31.14.131:33749, startcode=1689703817568 2023-07-18 18:10:19,795 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41889,1689703815990 with isa=jenkins-hbase4.apache.org/172.31.14.131:39363, startcode=1689703817431 2023-07-18 18:10:19,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-18 18:10:19,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-18 18:10:19,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:19,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:19,807 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:19,810 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689703849810 2023-07-18 18:10:19,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-18 18:10:19,818 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:10:19,818 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-18 18:10:19,820 DEBUG [RS:0;jenkins-hbase4:39363] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:10:19,820 DEBUG [RS:2;jenkins-hbase4:38743] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:10:19,820 DEBUG [RS:1;jenkins-hbase4:33749] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-18 18:10:19,826 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:19,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-18 18:10:19,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-18 18:10:19,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-18 18:10:19,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-18 18:10:19,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-18 18:10:19,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-18 18:10:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-18 18:10:19,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-18 18:10:19,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-18 18:10:19,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-18 18:10:19,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689703819854,5,FailOnTimeoutGroup] 2023-07-18 18:10:19,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689703819860,5,FailOnTimeoutGroup] 2023-07-18 18:10:19,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-18 18:10:19,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:19,897 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:19,899 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:19,899 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:19,909 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51025, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:10:19,909 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53647, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:10:19,909 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34777, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-18 18:10:19,925 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41889] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:19,946 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41889] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:19,949 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41889] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:19,959 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:19,959 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43971 2023-07-18 18:10:19,959 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 18:10:19,964 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:19,964 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43971 2023-07-18 18:10:19,964 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 18:10:19,965 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:19,965 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43971 2023-07-18 18:10:19,965 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-18 18:10:19,968 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:19,969 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:10:19,971 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:10:19,977 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/info 2023-07-18 18:10:19,977 DEBUG [RS:2;jenkins-hbase4:38743] zookeeper.ZKUtil(162): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:19,978 WARN [RS:2;jenkins-hbase4:38743] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:19,978 DEBUG [RS:0;jenkins-hbase4:39363] zookeeper.ZKUtil(162): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:19,978 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33749,1689703817568] 2023-07-18 18:10:19,979 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:10:19,978 DEBUG [RS:1;jenkins-hbase4:33749] zookeeper.ZKUtil(162): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:19,979 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38743,1689703817702] 2023-07-18 18:10:19,978 WARN [RS:0;jenkins-hbase4:39363] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:19,978 INFO [RS:2;jenkins-hbase4:38743] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:19,980 INFO [RS:0;jenkins-hbase4:39363] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:19,980 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:19,980 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:19,979 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39363,1689703817431] 2023-07-18 18:10:19,980 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:19,979 WARN [RS:1;jenkins-hbase4:33749] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-18 18:10:19,981 INFO [RS:1;jenkins-hbase4:33749] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:19,981 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:19,985 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:10:19,998 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:10:19,999 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:10:20,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,000 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:10:20,002 DEBUG [RS:1;jenkins-hbase4:33749] zookeeper.ZKUtil(162): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:20,004 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/table 2023-07-18 18:10:20,005 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:10:20,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,007 DEBUG [RS:2;jenkins-hbase4:38743] zookeeper.ZKUtil(162): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:20,008 DEBUG [RS:1;jenkins-hbase4:33749] zookeeper.ZKUtil(162): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:20,008 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740 2023-07-18 18:10:20,009 DEBUG [RS:2;jenkins-hbase4:38743] zookeeper.ZKUtil(162): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:20,009 DEBUG [RS:2;jenkins-hbase4:38743] zookeeper.ZKUtil(162): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:20,010 DEBUG [RS:1;jenkins-hbase4:33749] zookeeper.ZKUtil(162): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:20,010 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740 2023-07-18 18:10:20,016 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:10:20,018 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:10:20,019 DEBUG [RS:0;jenkins-hbase4:39363] zookeeper.ZKUtil(162): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:20,019 DEBUG [RS:0;jenkins-hbase4:39363] zookeeper.ZKUtil(162): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:20,020 DEBUG [RS:0;jenkins-hbase4:39363] zookeeper.ZKUtil(162): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:20,048 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:10:20,048 DEBUG [RS:1;jenkins-hbase4:33749] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:10:20,048 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-18 18:10:20,051 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:20,053 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63984851, jitterRate=-0.0465514212846756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:10:20,053 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:10:20,053 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:10:20,053 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:10:20,053 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:10:20,053 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:10:20,053 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:10:20,055 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:10:20,056 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:10:20,063 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-18 18:10:20,063 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-18 18:10:20,063 INFO [RS:1;jenkins-hbase4:33749] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:10:20,063 INFO [RS:0;jenkins-hbase4:39363] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:10:20,068 INFO [RS:2;jenkins-hbase4:38743] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-18 18:10:20,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-18 18:10:20,106 INFO [RS:0;jenkins-hbase4:39363] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:10:20,106 INFO [RS:1;jenkins-hbase4:33749] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:10:20,107 INFO [RS:2;jenkins-hbase4:38743] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-18 18:10:20,107 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-18 18:10:20,116 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-18 18:10:20,122 INFO [RS:0;jenkins-hbase4:39363] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:10:20,122 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,156 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:10:20,143 INFO [RS:2;jenkins-hbase4:38743] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:10:20,151 INFO [RS:1;jenkins-hbase4:33749] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-18 18:10:20,160 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,161 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,176 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:10:20,176 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-18 18:10:20,181 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,181 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,181 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,182 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,183 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,184 DEBUG [RS:1;jenkins-hbase4:33749] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,182 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,184 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,184 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,184 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,184 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,184 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:20,185 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,185 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,185 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,185 DEBUG [RS:2;jenkins-hbase4:38743] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,194 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,198 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,199 DEBUG [RS:0;jenkins-hbase4:39363] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-18 18:10:20,208 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,212 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,212 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,216 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,216 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,216 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,235 INFO [RS:1;jenkins-hbase4:33749] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:10:20,235 INFO [RS:2;jenkins-hbase4:38743] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:10:20,239 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38743,1689703817702-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,239 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33749,1689703817568-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,242 INFO [RS:0;jenkins-hbase4:39363] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-18 18:10:20,242 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39363,1689703817431-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,271 DEBUG [jenkins-hbase4:41889] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-18 18:10:20,276 DEBUG [jenkins-hbase4:41889] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:20,286 INFO [RS:1;jenkins-hbase4:33749] regionserver.Replication(203): jenkins-hbase4.apache.org,33749,1689703817568 started 2023-07-18 18:10:20,286 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33749,1689703817568, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33749, sessionid=0x10179a09a920002 2023-07-18 18:10:20,286 DEBUG [jenkins-hbase4:41889] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:20,286 DEBUG [jenkins-hbase4:41889] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:20,286 DEBUG [jenkins-hbase4:41889] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:20,286 DEBUG [jenkins-hbase4:41889] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:20,296 INFO [RS:2;jenkins-hbase4:38743] regionserver.Replication(203): jenkins-hbase4.apache.org,38743,1689703817702 started 2023-07-18 18:10:20,296 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38743,1689703817702, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38743, sessionid=0x10179a09a920003 2023-07-18 18:10:20,296 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:10:20,297 DEBUG [RS:2;jenkins-hbase4:38743] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:20,297 DEBUG [RS:2;jenkins-hbase4:38743] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38743,1689703817702' 2023-07-18 18:10:20,297 DEBUG [RS:2;jenkins-hbase4:38743] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:10:20,300 INFO [RS:0;jenkins-hbase4:39363] regionserver.Replication(203): jenkins-hbase4.apache.org,39363,1689703817431 started 2023-07-18 18:10:20,300 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:10:20,300 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39363,1689703817431, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39363, sessionid=0x10179a09a920001 2023-07-18 18:10:20,303 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-18 18:10:20,303 DEBUG [RS:0;jenkins-hbase4:39363] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:20,304 DEBUG [RS:0;jenkins-hbase4:39363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39363,1689703817431' 2023-07-18 18:10:20,304 DEBUG [RS:0;jenkins-hbase4:39363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:10:20,303 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38743,1689703817702, state=OPENING 2023-07-18 18:10:20,305 DEBUG [RS:0;jenkins-hbase4:39363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:10:20,306 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:10:20,306 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:10:20,306 DEBUG [RS:0;jenkins-hbase4:39363] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:20,306 DEBUG [RS:0;jenkins-hbase4:39363] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39363,1689703817431' 2023-07-18 18:10:20,306 DEBUG [RS:0;jenkins-hbase4:39363] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:20,300 DEBUG [RS:1;jenkins-hbase4:33749] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:20,305 DEBUG [RS:2;jenkins-hbase4:38743] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:10:20,310 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:10:20,310 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:10:20,309 DEBUG [RS:1;jenkins-hbase4:33749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33749,1689703817568' 2023-07-18 18:10:20,312 DEBUG [RS:1;jenkins-hbase4:33749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-18 18:10:20,310 DEBUG [RS:2;jenkins-hbase4:38743] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:20,313 DEBUG [RS:2;jenkins-hbase4:38743] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38743,1689703817702' 2023-07-18 18:10:20,313 DEBUG [RS:2;jenkins-hbase4:38743] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:20,313 DEBUG [RS:0;jenkins-hbase4:39363] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:20,313 DEBUG [RS:1;jenkins-hbase4:33749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-18 18:10:20,313 DEBUG [RS:2;jenkins-hbase4:38743] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:20,315 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-18 18:10:20,315 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-18 18:10:20,315 DEBUG [RS:1;jenkins-hbase4:33749] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:20,315 DEBUG [RS:1;jenkins-hbase4:33749] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33749,1689703817568' 2023-07-18 18:10:20,315 DEBUG [RS:1;jenkins-hbase4:33749] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:20,315 DEBUG [RS:1;jenkins-hbase4:33749] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:20,316 DEBUG [RS:1;jenkins-hbase4:33749] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:10:20,316 INFO [RS:1;jenkins-hbase4:33749] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:10:20,316 INFO [RS:1;jenkins-hbase4:33749] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:10:20,318 DEBUG [RS:0;jenkins-hbase4:39363] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:10:20,318 DEBUG [RS:2;jenkins-hbase4:38743] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-18 18:10:20,318 INFO [RS:0;jenkins-hbase4:39363] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:10:20,319 INFO [RS:2;jenkins-hbase4:38743] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-18 18:10:20,319 INFO [RS:0;jenkins-hbase4:39363] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:10:20,319 INFO [RS:2;jenkins-hbase4:38743] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-18 18:10:20,321 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-18 18:10:20,323 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:20,324 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:10:20,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:10:20,432 INFO [RS:0;jenkins-hbase4:39363] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39363%2C1689703817431, suffix=, logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,39363,1689703817431, archiveDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs, maxLogs=32 2023-07-18 18:10:20,436 INFO [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38743%2C1689703817702, suffix=, logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,38743,1689703817702, archiveDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs, maxLogs=32 2023-07-18 18:10:20,447 INFO [RS:1;jenkins-hbase4:33749] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33749%2C1689703817568, suffix=, logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,33749,1689703817568, archiveDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs, maxLogs=32 2023-07-18 18:10:20,486 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK] 2023-07-18 18:10:20,486 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK] 2023-07-18 18:10:20,487 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK] 2023-07-18 18:10:20,488 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK] 2023-07-18 18:10:20,488 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK] 2023-07-18 18:10:20,488 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK] 2023-07-18 18:10:20,505 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK] 2023-07-18 18:10:20,505 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK] 2023-07-18 18:10:20,505 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK] 2023-07-18 18:10:20,514 INFO [RS:0;jenkins-hbase4:39363] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,39363,1689703817431/jenkins-hbase4.apache.org%2C39363%2C1689703817431.1689703820435 2023-07-18 18:10:20,519 DEBUG [RS:0;jenkins-hbase4:39363] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK], DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK]] 2023-07-18 18:10:20,523 INFO [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,38743,1689703817702/jenkins-hbase4.apache.org%2C38743%2C1689703817702.1689703820438 2023-07-18 18:10:20,524 INFO [RS:1;jenkins-hbase4:33749] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,33749,1689703817568/jenkins-hbase4.apache.org%2C33749%2C1689703817568.1689703820448 2023-07-18 18:10:20,527 DEBUG [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK], DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK], DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK]] 2023-07-18 18:10:20,527 DEBUG [RS:1;jenkins-hbase4:33749] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK], DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK]] 2023-07-18 18:10:20,537 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:20,539 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:10:20,543 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51042, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:10:20,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-18 18:10:20,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-18 18:10:20,568 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38743%2C1689703817702.meta, suffix=.meta, logDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,38743,1689703817702, archiveDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs, maxLogs=32 2023-07-18 18:10:20,593 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK] 2023-07-18 18:10:20,594 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK] 2023-07-18 18:10:20,595 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK] 2023-07-18 18:10:20,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/WALs/jenkins-hbase4.apache.org,38743,1689703817702/jenkins-hbase4.apache.org%2C38743%2C1689703817702.meta.1689703820570.meta 2023-07-18 18:10:20,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42831,DS-723677ff-b9df-4785-8206-f010d441233c,DISK], DatanodeInfoWithStorage[127.0.0.1:34477,DS-a0637f31-4b11-4dd3-b096-e6b643a82c6c,DISK], DatanodeInfoWithStorage[127.0.0.1:34733,DS-59c643b3-edb9-4b30-808e-0d8e36a0e53d,DISK]] 2023-07-18 18:10:20,603 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:20,604 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-18 18:10:20,606 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:20,607 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-18 18:10:20,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-18 18:10:20,611 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-18 18:10:20,628 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-18 18:10:20,628 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:20,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-18 18:10:20,629 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-18 18:10:20,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-18 18:10:20,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/info 2023-07-18 18:10:20,635 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/info 2023-07-18 18:10:20,636 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-18 18:10:20,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,637 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-18 18:10:20,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:10:20,642 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/rep_barrier 2023-07-18 18:10:20,642 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-18 18:10:20,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,643 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-18 18:10:20,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/table 2023-07-18 18:10:20,645 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/table 2023-07-18 18:10:20,646 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-18 18:10:20,646 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:20,649 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740 2023-07-18 18:10:20,657 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740 2023-07-18 18:10:20,662 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-18 18:10:20,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-18 18:10:20,667 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69751726, jitterRate=0.039381712675094604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-18 18:10:20,670 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-18 18:10:20,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689703820528 2023-07-18 18:10:20,703 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-18 18:10:20,704 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-18 18:10:20,704 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38743,1689703817702, state=OPEN 2023-07-18 18:10:20,707 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-18 18:10:20,707 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-18 18:10:20,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-18 18:10:20,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38743,1689703817702 in 378 msec 2023-07-18 18:10:20,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-18 18:10:20,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 639 msec 2023-07-18 18:10:20,723 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0630 sec 2023-07-18 18:10:20,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689703820723, completionTime=-1 2023-07-18 18:10:20,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-18 18:10:20,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-18 18:10:20,805 DEBUG [hconnection-0x730b4be8-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:20,809 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:20,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-18 18:10:20,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689703880834 2023-07-18 18:10:20,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689703940834 2023-07-18 18:10:20,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-07-18 18:10:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41889,1689703815990-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,873 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41889,1689703815990-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,875 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41889,1689703815990-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41889, period=300000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,877 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-18 18:10:20,920 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-18 18:10:20,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-18 18:10:20,928 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:20,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-18 18:10:20,944 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:20,948 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:20,974 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:20,977 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825 empty. 2023-07-18 18:10:20,977 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:20,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-18 18:10:21,036 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:21,039 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e644a00a8889d67b87d5f691cbd8f825, NAME => 'hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:10:21,067 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:21,067 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e644a00a8889d67b87d5f691cbd8f825, disabling compactions & flushes 2023-07-18 18:10:21,067 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,067 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,068 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. after waiting 0 ms 2023-07-18 18:10:21,068 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,068 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,068 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e644a00a8889d67b87d5f691cbd8f825: 2023-07-18 18:10:21,076 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:21,100 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689703821080"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703821080"}]},"ts":"1689703821080"} 2023-07-18 18:10:21,142 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:10:21,144 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:21,149 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703821144"}]},"ts":"1689703821144"} 2023-07-18 18:10:21,153 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-18 18:10:21,158 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:21,159 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:21,159 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:21,159 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:21,159 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:21,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e644a00a8889d67b87d5f691cbd8f825, ASSIGN}] 2023-07-18 18:10:21,167 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e644a00a8889d67b87d5f691cbd8f825, ASSIGN 2023-07-18 18:10:21,169 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e644a00a8889d67b87d5f691cbd8f825, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39363,1689703817431; forceNewPlan=false, retain=false 2023-07-18 18:10:21,322 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:10:21,324 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e644a00a8889d67b87d5f691cbd8f825, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:21,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689703821323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703821323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703821323"}]},"ts":"1689703821323"} 2023-07-18 18:10:21,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e644a00a8889d67b87d5f691cbd8f825, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:10:21,487 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:21,487 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:10:21,490 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:10:21,496 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e644a00a8889d67b87d5f691cbd8f825, NAME => 'hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:21,496 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. service=AccessControlService 2023-07-18 18:10:21,497 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:21,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:21,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,500 INFO [StoreOpener-e644a00a8889d67b87d5f691cbd8f825-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,502 DEBUG [StoreOpener-e644a00a8889d67b87d5f691cbd8f825-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/info 2023-07-18 18:10:21,502 DEBUG [StoreOpener-e644a00a8889d67b87d5f691cbd8f825-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/info 2023-07-18 18:10:21,503 INFO [StoreOpener-e644a00a8889d67b87d5f691cbd8f825-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e644a00a8889d67b87d5f691cbd8f825 columnFamilyName info 2023-07-18 18:10:21,504 INFO [StoreOpener-e644a00a8889d67b87d5f691cbd8f825-1] regionserver.HStore(310): Store=e644a00a8889d67b87d5f691cbd8f825/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:21,506 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,507 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,512 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:10:21,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:21,517 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e644a00a8889d67b87d5f691cbd8f825; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66182033, jitterRate=-0.013810858130455017}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:21,517 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e644a00a8889d67b87d5f691cbd8f825: 2023-07-18 18:10:21,519 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825., pid=6, masterSystemTime=1689703821487 2023-07-18 18:10:21,524 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,524 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:10:21,526 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e644a00a8889d67b87d5f691cbd8f825, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:21,526 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689703821525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703821525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703821525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703821525"}]},"ts":"1689703821525"} 2023-07-18 18:10:21,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-18 18:10:21,533 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e644a00a8889d67b87d5f691cbd8f825, server=jenkins-hbase4.apache.org,39363,1689703817431 in 198 msec 2023-07-18 18:10:21,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-18 18:10:21,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e644a00a8889d67b87d5f691cbd8f825, ASSIGN in 371 msec 2023-07-18 18:10:21,538 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:21,539 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703821538"}]},"ts":"1689703821538"} 2023-07-18 18:10:21,541 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-18 18:10:21,545 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:21,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-18 18:10:21,547 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:10:21,547 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:21,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 616 msec 2023-07-18 18:10:21,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:21,570 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:21,584 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-18 18:10:21,600 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:10:21,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-18 18:10:21,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-18 18:10:21,630 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-18 18:10:21,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-18 18:10:21,646 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-18 18:10:21,651 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-18 18:10:21,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.506sec 2023-07-18 18:10:21,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-18 18:10:21,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-18 18:10:21,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-18 18:10:21,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41889,1689703815990-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-18 18:10:21,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41889,1689703815990-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-18 18:10:21,659 DEBUG [Listener at localhost/36595] zookeeper.ReadOnlyZKClient(139): Connect 0x7b4bf029 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:21,664 DEBUG [Listener at localhost/36595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1370d70b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:21,682 DEBUG [hconnection-0x226ad64-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:21,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:21,689 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-18 18:10:21,691 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:21,694 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:21,698 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-18 18:10:21,698 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/acl/7b13b8097114f6c946827d0018950962 2023-07-18 18:10:21,698 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:21,700 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/acl/7b13b8097114f6c946827d0018950962 empty. 2023-07-18 18:10:21,700 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:10:21,700 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-18 18:10:21,700 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/test.cache.data in system properties and HBase conf 2023-07-18 18:10:21,700 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop.tmp.dir in system properties and HBase conf 2023-07-18 18:10:21,700 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop.log.dir in system properties and HBase conf 2023-07-18 18:10:21,700 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-18 18:10:21,701 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-18 18:10:21,702 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-18 18:10:21,702 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/acl/7b13b8097114f6c946827d0018950962 2023-07-18 18:10:21,702 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:21,703 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-18 18:10:21,703 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/nfs.dump.dir in system properties and HBase conf 2023-07-18 18:10:21,704 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir in system properties and HBase conf 2023-07-18 18:10:21,704 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-18 18:10:21,704 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-18 18:10:21,704 INFO [Listener at localhost/36595] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-18 18:10:21,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:21,752 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:21,759 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7b13b8097114f6c946827d0018950962, NAME => 'hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:10:21,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:21,832 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:21,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 7b13b8097114f6c946827d0018950962, disabling compactions & flushes 2023-07-18 18:10:21,833 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:21,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:21,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. after waiting 0 ms 2023-07-18 18:10:21,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:21,833 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:21,833 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 7b13b8097114f6c946827d0018950962: 2023-07-18 18:10:21,840 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:21,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689703821842"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703821842"}]},"ts":"1689703821842"} 2023-07-18 18:10:21,845 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-18 18:10:21,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:21,847 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703821846"}]},"ts":"1689703821846"} 2023-07-18 18:10:21,850 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-18 18:10:21,861 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:21,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:21,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:21,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:21,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:21,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7b13b8097114f6c946827d0018950962, ASSIGN}] 2023-07-18 18:10:21,876 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=7b13b8097114f6c946827d0018950962, ASSIGN 2023-07-18 18:10:21,880 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=7b13b8097114f6c946827d0018950962, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38743,1689703817702; forceNewPlan=false, retain=false 2023-07-18 18:10:22,014 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:22,030 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:10:22,031 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7b13b8097114f6c946827d0018950962, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:22,032 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689703822031"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703822031"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703822031"}]},"ts":"1689703822031"} 2023-07-18 18:10:22,036 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 7b13b8097114f6c946827d0018950962, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:10:22,198 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:22,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7b13b8097114f6c946827d0018950962, NAME => 'hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:10:22,199 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. service=AccessControlService 2023-07-18 18:10:22,199 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:22,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:22,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,200 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,204 INFO [StoreOpener-7b13b8097114f6c946827d0018950962-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,206 DEBUG [StoreOpener-7b13b8097114f6c946827d0018950962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/l 2023-07-18 18:10:22,206 DEBUG [StoreOpener-7b13b8097114f6c946827d0018950962-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/l 2023-07-18 18:10:22,207 INFO [StoreOpener-7b13b8097114f6c946827d0018950962-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b13b8097114f6c946827d0018950962 columnFamilyName l 2023-07-18 18:10:22,208 INFO [StoreOpener-7b13b8097114f6c946827d0018950962-1] regionserver.HStore(310): Store=7b13b8097114f6c946827d0018950962/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:22,211 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,212 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7b13b8097114f6c946827d0018950962 2023-07-18 18:10:22,221 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:22,222 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7b13b8097114f6c946827d0018950962; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66096302, jitterRate=-0.01508834958076477}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:22,223 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7b13b8097114f6c946827d0018950962: 2023-07-18 18:10:22,224 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962., pid=11, masterSystemTime=1689703822191 2023-07-18 18:10:22,227 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:22,227 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:10:22,228 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=7b13b8097114f6c946827d0018950962, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:22,228 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689703822228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703822228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703822228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703822228"}]},"ts":"1689703822228"} 2023-07-18 18:10:22,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-18 18:10:22,237 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 7b13b8097114f6c946827d0018950962, server=jenkins-hbase4.apache.org,38743,1689703817702 in 195 msec 2023-07-18 18:10:22,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-18 18:10:22,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=7b13b8097114f6c946827d0018950962, ASSIGN in 368 msec 2023-07-18 18:10:22,244 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:22,245 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703822244"}]},"ts":"1689703822244"} 2023-07-18 18:10:22,247 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-18 18:10:22,253 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:22,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 567 msec 2023-07-18 18:10:22,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-18 18:10:22,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-18 18:10:22,326 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-18 18:10:23,084 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:23,393 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:23,403 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35745_jobhistory____je2arj/webapp 2023-07-18 18:10:23,572 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-18 18:10:23,572 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:23,572 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:23,576 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:23,649 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:23,947 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:24,286 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-18 18:10:24,323 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35745 2023-07-18 18:10:24,573 WARN [Listener at jenkins-hbase4.apache.org/33273] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:24,953 WARN [Listener at jenkins-hbase4.apache.org/33273] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 18:10:24,954 INFO [Listener at jenkins-hbase4.apache.org/33273] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:24,962 INFO [Listener at jenkins-hbase4.apache.org/33273] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43165_cluster____eu71o3/webapp 2023-07-18 18:10:25,063 INFO [Listener at jenkins-hbase4.apache.org/33273] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:25,064 INFO [Listener at jenkins-hbase4.apache.org/33273] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-18 18:10:25,064 INFO [Listener at jenkins-hbase4.apache.org/33273] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:25,065 INFO [Listener at jenkins-hbase4.apache.org/33273] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:25,106 INFO [Listener at jenkins-hbase4.apache.org/33273] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:25,343 INFO [Listener at jenkins-hbase4.apache.org/33273] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:25,499 INFO [Listener at jenkins-hbase4.apache.org/33273] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:25,532 INFO [Listener at jenkins-hbase4.apache.org/33273] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43165 2023-07-18 18:10:26,425 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:10:26,592 WARN [Listener at jenkins-hbase4.apache.org/39515] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:26,613 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-18 18:10:26,615 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-18 18:10:26,616 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-18 18:10:26,622 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:26,623 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-18 18:10:26,623 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:26,623 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-18 18:10:26,623 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 18:10:26,623 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-18 18:10:26,624 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:26,624 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-18 18:10:26,624 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:10:26,624 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-18 18:10:26,632 WARN [Listener at jenkins-hbase4.apache.org/39515] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 18:10:26,633 INFO [Listener at jenkins-hbase4.apache.org/39515] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:26,639 INFO [Listener at jenkins-hbase4.apache.org/39515] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39559_node____.7swdhr/webapp 2023-07-18 18:10:26,699 INFO [Listener at jenkins-hbase4.apache.org/39515] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 18:10:26,700 INFO [Listener at jenkins-hbase4.apache.org/39515] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:26,700 INFO [Listener at jenkins-hbase4.apache.org/39515] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:26,700 INFO [Listener at jenkins-hbase4.apache.org/39515] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:26,718 INFO [Listener at jenkins-hbase4.apache.org/39515] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:26,754 INFO [Listener at jenkins-hbase4.apache.org/39515] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:26,845 INFO [Listener at jenkins-hbase4.apache.org/39515] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:26,871 INFO [Listener at jenkins-hbase4.apache.org/39515] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39559 2023-07-18 18:10:27,093 WARN [Listener at jenkins-hbase4.apache.org/45437] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-18 18:10:27,103 WARN [Listener at jenkins-hbase4.apache.org/45437] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-18 18:10:27,103 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): jetty-6.1.26 2023-07-18 18:10:27,111 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37921_node____.o4deni/webapp 2023-07-18 18:10:27,187 INFO [Listener at jenkins-hbase4.apache.org/45437] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-18 18:10:27,187 INFO [Listener at jenkins-hbase4.apache.org/45437] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-18 18:10:27,187 INFO [Listener at jenkins-hbase4.apache.org/45437] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-18 18:10:27,187 INFO [Listener at jenkins-hbase4.apache.org/45437] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-18 18:10:27,196 INFO [Listener at jenkins-hbase4.apache.org/45437] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,211 INFO [Listener at jenkins-hbase4.apache.org/45437] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,287 INFO [Listener at jenkins-hbase4.apache.org/45437] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-18 18:10:27,294 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37921 2023-07-18 18:10:27,317 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-18 18:10:27,319 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:27,385 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=707, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=324, ProcessCount=177, AvailableMemoryMB=4861 2023-07-18 18:10:27,385 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=707 is superior to 500 2023-07-18 18:10:27,400 DEBUG [Listener at jenkins-hbase4.apache.org/45437] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-18 18:10:27,406 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-18 18:10:27,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:27,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:27,419 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:27,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-18 18:10:27,421 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:27,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:27,426 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,427 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,429 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b empty. 2023-07-18 18:10:27,429 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 empty. 2023-07-18 18:10:27,432 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,432 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,432 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 18:10:27,473 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:27,475 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f9f1b9839f3e9c6c9c8fca77e4f56fe0, NAME => 'testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:10:27,475 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 81f3a3ec389fd85aef0684e97f24ef0b, NAME => 'testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:10:27,516 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:27,516 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 81f3a3ec389fd85aef0684e97f24ef0b, disabling compactions & flushes 2023-07-18 18:10:27,516 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,516 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,516 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. after waiting 0 ms 2023-07-18 18:10:27,516 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,520 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,520 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 81f3a3ec389fd85aef0684e97f24ef0b: 2023-07-18 18:10:27,524 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:27,525 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f9f1b9839f3e9c6c9c8fca77e4f56fe0, disabling compactions & flushes 2023-07-18 18:10:27,525 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,525 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,525 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. after waiting 0 ms 2023-07-18 18:10:27,525 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,526 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,526 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f9f1b9839f3e9c6c9c8fca77e4f56fe0: 2023-07-18 18:10:27,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:27,529 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:27,531 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703827531"}]},"ts":"1689703827531"} 2023-07-18 18:10:27,531 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827531"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703827531"}]},"ts":"1689703827531"} 2023-07-18 18:10:27,585 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:10:27,586 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:27,587 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703827586"}]},"ts":"1689703827586"} 2023-07-18 18:10:27,589 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-18 18:10:27,594 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:27,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:27,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:27,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:27,596 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:27,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, ASSIGN}] 2023-07-18 18:10:27,600 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, ASSIGN 2023-07-18 18:10:27,600 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, ASSIGN 2023-07-18 18:10:27,601 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:10:27,601 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39363,1689703817431; forceNewPlan=false, retain=false 2023-07-18 18:10:27,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:27,751 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:10:27,755 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f9f1b9839f3e9c6c9c8fca77e4f56fe0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:27,755 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=81f3a3ec389fd85aef0684e97f24ef0b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:27,755 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703827754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703827754"}]},"ts":"1689703827754"} 2023-07-18 18:10:27,755 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827754"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703827754"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703827754"}]},"ts":"1689703827754"} 2023-07-18 18:10:27,758 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure f9f1b9839f3e9c6c9c8fca77e4f56fe0, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:10:27,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 81f3a3ec389fd85aef0684e97f24ef0b, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:10:27,914 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:27,915 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:10:27,918 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37156, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:10:27,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 81f3a3ec389fd85aef0684e97f24ef0b, NAME => 'testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:10:27,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. service=AccessControlService 2023-07-18 18:10:27,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f9f1b9839f3e9c6c9c8fca77e4f56fe0, NAME => 'testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:10:27,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. service=AccessControlService 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,925 INFO [StoreOpener-81f3a3ec389fd85aef0684e97f24ef0b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,925 INFO [StoreOpener-f9f1b9839f3e9c6c9c8fca77e4f56fe0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,928 DEBUG [StoreOpener-f9f1b9839f3e9c6c9c8fca77e4f56fe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf 2023-07-18 18:10:27,928 DEBUG [StoreOpener-f9f1b9839f3e9c6c9c8fca77e4f56fe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf 2023-07-18 18:10:27,928 DEBUG [StoreOpener-81f3a3ec389fd85aef0684e97f24ef0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf 2023-07-18 18:10:27,928 DEBUG [StoreOpener-81f3a3ec389fd85aef0684e97f24ef0b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf 2023-07-18 18:10:27,928 INFO [StoreOpener-81f3a3ec389fd85aef0684e97f24ef0b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 81f3a3ec389fd85aef0684e97f24ef0b columnFamilyName cf 2023-07-18 18:10:27,928 INFO [StoreOpener-f9f1b9839f3e9c6c9c8fca77e4f56fe0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f9f1b9839f3e9c6c9c8fca77e4f56fe0 columnFamilyName cf 2023-07-18 18:10:27,929 INFO [StoreOpener-81f3a3ec389fd85aef0684e97f24ef0b-1] regionserver.HStore(310): Store=81f3a3ec389fd85aef0684e97f24ef0b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:27,930 INFO [StoreOpener-f9f1b9839f3e9c6c9c8fca77e4f56fe0-1] regionserver.HStore(310): Store=f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:27,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:27,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:27,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:27,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:27,952 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f9f1b9839f3e9c6c9c8fca77e4f56fe0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67760729, jitterRate=0.009713545441627502}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:27,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f9f1b9839f3e9c6c9c8fca77e4f56fe0: 2023-07-18 18:10:27,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 81f3a3ec389fd85aef0684e97f24ef0b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63367526, jitterRate=-0.0557502806186676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:27,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 81f3a3ec389fd85aef0684e97f24ef0b: 2023-07-18 18:10:27,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0., pid=15, masterSystemTime=1689703827914 2023-07-18 18:10:27,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b., pid=16, masterSystemTime=1689703827914 2023-07-18 18:10:27,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:27,960 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=81f3a3ec389fd85aef0684e97f24ef0b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:27,960 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703827960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703827960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703827960"}]},"ts":"1689703827960"} 2023-07-18 18:10:27,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:27,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f9f1b9839f3e9c6c9c8fca77e4f56fe0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:27,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703827962"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703827962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703827962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703827962"}]},"ts":"1689703827962"} 2023-07-18 18:10:27,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-18 18:10:27,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 81f3a3ec389fd85aef0684e97f24ef0b, server=jenkins-hbase4.apache.org,39363,1689703817431 in 206 msec 2023-07-18 18:10:27,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, ASSIGN in 374 msec 2023-07-18 18:10:27,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-18 18:10:27,990 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure f9f1b9839f3e9c6c9c8fca77e4f56fe0, server=jenkins-hbase4.apache.org,33749,1689703817568 in 224 msec 2023-07-18 18:10:27,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-18 18:10:27,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, ASSIGN in 393 msec 2023-07-18 18:10:27,995 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:27,995 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703827995"}]},"ts":"1689703827995"} 2023-07-18 18:10:27,997 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-18 18:10:28,000 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:28,005 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-18 18:10:28,023 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 18:10:28,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:28,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:10:28,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:28,068 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,068 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,068 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,068 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:28,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 655 msec 2023-07-18 18:10:28,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-18 18:10:28,533 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-18 18:10:28,533 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-18 18:10:28,534 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:28,540 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-18 18:10:28,541 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:28,541 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-18 18:10:28,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:28,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703828556 (current time:1689703828556). 2023-07-18 18:10:28,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:28,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x4c54da89 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:28,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c2d9943, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:28,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,570 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:28,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c54da89 to 127.0.0.1:55531 2023-07-18 18:10:28,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:28,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x294bb71b to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:28,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15509c37, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:28,587 DEBUG [hconnection-0x266a0a1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,588 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:28,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x294bb71b to 127.0.0.1:55531 2023-07-18 18:10:28,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:28,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 18:10:28,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:28,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:28,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:28,645 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:28,646 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689704428646 2023-07-18 18:10:28,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:28,646 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 18:10:28,649 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:28,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:28,652 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:28,653 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 16 msec 2023-07-18 18:10:28,653 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:28,654 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:28,655 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689704428655 2023-07-18 18:10:28,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,683 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-18 18:10:28,684 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,684 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 18:10:28,684 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 18:10:28,685 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,685 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,689 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,690 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,690 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,691 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,691 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-18 18:10:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:28,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:28,692 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:28,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,695 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,696 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:28,697 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:28,697 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:28,698 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:28,701 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,701 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,701 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,703 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,703 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,704 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,704 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,704 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:28,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a4f699[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:28,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53a4f699[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:28,712 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 18:10:28,712 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,714 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,714 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:28,714 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:10:28,715 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,716 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:28,716 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:28,716 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:28,717 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. started... 2023-07-18 18:10:28,717 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. started... 2023-07-18 18:10:28,718 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,720 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:28,722 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81f3a3ec389fd85aef0684e97f24ef0b: 2023-07-18 18:10:28,722 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9f1b9839f3e9c6c9c8fca77e4f56fe0: 2023-07-18 18:10:28,723 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,723 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,730 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:28,730 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:28,734 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:28,734 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:28,754 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:28,756 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. completed. 2023-07-18 18:10:28,756 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:28,756 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,757 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:28,757 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:10:28,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:28,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:28,762 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:28,762 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. completed. 2023-07-18 18:10:28,762 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:28,762 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:28,762 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:28,762 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,762 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:28,762 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:10:28,763 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,766 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,766 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:28,767 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,767 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:28,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,769 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:28,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,769 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,769 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:28,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:10:28,774 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 18:10:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:10:28,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 18:10:28,784 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-18 18:10:28,784 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:28,784 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:28,784 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,784 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:28,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,793 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,794 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:28,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,795 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,796 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,800 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:28,801 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,802 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,817 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,817 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,817 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:28,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:28,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:28,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:28,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:28,819 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:28,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:28,819 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:28,819 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:28,819 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,820 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,820 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,915 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 18:10:28,915 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,916 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:28,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689703828646Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689703828819 (+173 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689703828821 (+2 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689703828835 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689703828854 (+19 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689703828915 (+61 ms) 2023-07-18 18:10:28,918 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:28,924 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 270 msec 2023-07-18 18:10:28,962 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:28,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:28,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:28,987 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,988 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:28,997 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37160, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:29,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33749] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:29,001 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:29,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39363] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:29,013 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-18 18:10:29,014 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:29,017 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:29,057 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:29,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703829058 (current time:1689703829058). 2023-07-18 18:10:29,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:29,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x74fe30dc to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:29,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@121a8c31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:29,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:29,074 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:29,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74fe30dc to 127.0.0.1:55531 2023-07-18 18:10:29,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:29,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x3b4ba471 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:29,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2aa352aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:29,085 DEBUG [hconnection-0x9948852-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:29,089 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:29,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b4ba471 to 127.0.0.1:55531 2023-07-18 18:10:29,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:29,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-18 18:10:29,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:29,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:29,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:29,100 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:29,102 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689704429102 2023-07-18 18:10:29,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-18 18:10:29,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-18 18:10:29,104 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:29,104 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:29,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:29,105 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-18 18:10:29,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-18 18:10:29,108 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:29,109 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689704429109 2023-07-18 18:10:29,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-18 18:10:29,142 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-18 18:10:29,142 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,143 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-18 18:10:29,144 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-18 18:10:29,144 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,144 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,146 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,146 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,146 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,146 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,151 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,151 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,152 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,152 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 18:10:29,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,152 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:29,153 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:29,154 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:29,154 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:29,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-18 18:10:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:29,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:29,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,155 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-18 18:10:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:29,156 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-18 18:10:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-18 18:10:29,158 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-18 18:10:29,160 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,162 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,162 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,162 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:29,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,163 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,163 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:29,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeea7de[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-18 18:10:29,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2aeea7de[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:29,168 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-18 18:10:29,168 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:29,173 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,173 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:29,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:29,173 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:29,173 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,174 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. started... 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:29,173 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-18 18:10:29,173 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:29,174 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f9f1b9839f3e9c6c9c8fca77e4f56fe0 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 18:10:29,174 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. started... 2023-07-18 18:10:29,174 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 81f3a3ec389fd85aef0684e97f24ef0b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 18:10:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:29,174 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:29,174 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:10:29,184 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:29,184 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:29,184 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:29,204 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:29,206 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:29,282 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/.tmp/cf/16ab0984d9e346c2985bfe3a278ea17e 2023-07-18 18:10:29,284 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/.tmp/cf/3d359982fb314a4fae29f88e82b91bd1 2023-07-18 18:10:29,341 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/.tmp/cf/3d359982fb314a4fae29f88e82b91bd1 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf/3d359982fb314a4fae29f88e82b91bd1 2023-07-18 18:10:29,341 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/.tmp/cf/16ab0984d9e346c2985bfe3a278ea17e as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf/16ab0984d9e346c2985bfe3a278ea17e 2023-07-18 18:10:29,351 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf/3d359982fb314a4fae29f88e82b91bd1, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 18:10:29,353 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf/16ab0984d9e346c2985bfe3a278ea17e, entries=47, sequenceid=6, filesize=8 K 2023-07-18 18:10:29,358 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 81f3a3ec389fd85aef0684e97f24ef0b in 184ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:29,358 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for f9f1b9839f3e9c6c9c8fca77e4f56fe0 in 184ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:29,358 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 18:10:29,358 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-18 18:10:29,362 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f9f1b9839f3e9c6c9c8fca77e4f56fe0: 2023-07-18 18:10:29,362 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 81f3a3ec389fd85aef0684e97f24ef0b: 2023-07-18 18:10:29,362 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:29,362 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:29,362 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:29,363 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:29,363 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf/16ab0984d9e346c2985bfe3a278ea17e] hfiles 2023-07-18 18:10:29,363 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf/3d359982fb314a4fae29f88e82b91bd1] hfiles 2023-07-18 18:10:29,363 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf/16ab0984d9e346c2985bfe3a278ea17e for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:29,363 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf/3d359982fb314a4fae29f88e82b91bd1 for snapshot=snaptb0-testExportWithTargetName 2023-07-18 18:10:29,406 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:29,408 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. completed. 2023-07-18 18:10:29,409 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:29,409 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:29,409 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:29,411 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:10:29,414 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,414 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,414 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:29,414 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:29,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,416 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. completed. 2023-07-18 18:10:29,416 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-18 18:10:29,416 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:10:29,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-18 18:10:29,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,418 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:29,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-18 18:10:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:10:29,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-18 18:10:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:10:29,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-18 18:10:29,426 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-18 18:10:29,426 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:29,426 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:29,426 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-18 18:10:29,426 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:29,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:29,429 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,428 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:29,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,429 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:29,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:29,430 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:29,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,432 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:29,433 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-18 18:10:29,433 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,445 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,445 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,445 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:29,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:29,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:29,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-18 18:10:29,446 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:29,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:29,448 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,448 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:29,448 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:29,448 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,448 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,446 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:29,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:29,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:29,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:29,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:29,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:29,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,520 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-18 18:10:29,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,520 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-18 18:10:29,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689703829102Consolidate snapshot: snaptb0-testExportWithTargetName at 1689703829447 (+345 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689703829448 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1689703829453 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689703829471 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689703829520 (+49 ms) 2023-07-18 18:10:29,522 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-18 18:10:29,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 419 msec 2023-07-18 18:10:29,709 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:29,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-18 18:10:29,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:29,713 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713 2023-07-18 18:10:29,713 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43971, tgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713, rawTgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:29,764 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:29,765 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1758697750_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 18:10:29,765 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-18 18:10:29,789 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-18 18:10:30,291 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,292 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,293 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,293 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,294 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,294 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,294 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,382 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-3670371224574221859.jar 2023-07-18 18:10:30,383 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,384 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,384 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,385 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,385 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,386 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:30,386 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:10:30,387 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:10:30,387 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:10:30,388 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:10:30,388 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:10:30,388 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:10:30,389 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:10:30,389 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:10:30,390 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:10:30,390 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:10:30,394 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:30,395 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:30,395 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:30,396 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:30,396 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:30,397 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:30,397 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:31,406 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:10:31,411 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-18 18:10:31,420 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 18:10:31,937 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:31,938 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:32,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:33,442 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:10:37,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:39,764 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:42,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:44,359 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:10:44,368 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:10:44,390 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-18 18:10:44,391 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:10:44,391 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:10:44,392 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-18 18:10:44,392 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-18 18:10:44,392 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-18 18:10:44,392 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713/.hbase-snapshot/testExportWithTargetName 2023-07-18 18:10:44,393 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-18 18:10:44,393 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703829713/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-18 18:10:44,405 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-18 18:10:44,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-18 18:10:44,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,424 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703844424"}]},"ts":"1689703844424"} 2023-07-18 18:10:44,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:44,427 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-18 18:10:44,428 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-18 18:10:44,430 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, UNASSIGN}] 2023-07-18 18:10:44,433 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, UNASSIGN 2023-07-18 18:10:44,433 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, UNASSIGN 2023-07-18 18:10:44,434 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f9f1b9839f3e9c6c9c8fca77e4f56fe0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:44,434 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=81f3a3ec389fd85aef0684e97f24ef0b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:44,434 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703844433"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703844433"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703844433"}]},"ts":"1689703844433"} 2023-07-18 18:10:44,434 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703844434"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703844434"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703844434"}]},"ts":"1689703844434"} 2023-07-18 18:10:44,436 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure f9f1b9839f3e9c6c9c8fca77e4f56fe0, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:10:44,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 81f3a3ec389fd85aef0684e97f24ef0b, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:10:44,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:44,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:44,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:44,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f9f1b9839f3e9c6c9c8fca77e4f56fe0, disabling compactions & flushes 2023-07-18 18:10:44,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 81f3a3ec389fd85aef0684e97f24ef0b, disabling compactions & flushes 2023-07-18 18:10:44,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:44,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:44,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:44,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:44,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. after waiting 0 ms 2023-07-18 18:10:44,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. after waiting 0 ms 2023-07-18 18:10:44,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:44,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:44,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:10:44,610 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:10:44,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:44,611 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:10:44,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b. 2023-07-18 18:10:44,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0. 2023-07-18 18:10:44,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 81f3a3ec389fd85aef0684e97f24ef0b: 2023-07-18 18:10:44,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f9f1b9839f3e9c6c9c8fca77e4f56fe0: 2023-07-18 18:10:44,615 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:44,617 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=81f3a3ec389fd85aef0684e97f24ef0b, regionState=CLOSED 2023-07-18 18:10:44,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:44,617 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703844617"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703844617"}]},"ts":"1689703844617"} 2023-07-18 18:10:44,618 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f9f1b9839f3e9c6c9c8fca77e4f56fe0, regionState=CLOSED 2023-07-18 18:10:44,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689703844618"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703844618"}]},"ts":"1689703844618"} 2023-07-18 18:10:44,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-18 18:10:44,623 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 81f3a3ec389fd85aef0684e97f24ef0b, server=jenkins-hbase4.apache.org,39363,1689703817431 in 181 msec 2023-07-18 18:10:44,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-18 18:10:44,623 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure f9f1b9839f3e9c6c9c8fca77e4f56fe0, server=jenkins-hbase4.apache.org,33749,1689703817568 in 184 msec 2023-07-18 18:10:44,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=81f3a3ec389fd85aef0684e97f24ef0b, UNASSIGN in 193 msec 2023-07-18 18:10:44,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-18 18:10:44,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f9f1b9839f3e9c6c9c8fca77e4f56fe0, UNASSIGN in 193 msec 2023-07-18 18:10:44,627 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703844627"}]},"ts":"1689703844627"} 2023-07-18 18:10:44,628 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-18 18:10:44,630 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-18 18:10:44,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 217 msec 2023-07-18 18:10:44,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-18 18:10:44,728 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-18 18:10:44,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-18 18:10:44,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,743 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-18 18:10:44,745 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,748 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-18 18:10:44,751 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:44,751 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:44,752 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,752 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,752 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,752 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:44,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:44,753 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:44,754 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:44,755 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:44,756 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/recovered.edits] 2023-07-18 18:10:44,756 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/recovered.edits] 2023-07-18 18:10:44,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 18:10:44,765 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf/3d359982fb314a4fae29f88e82b91bd1 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/cf/3d359982fb314a4fae29f88e82b91bd1 2023-07-18 18:10:44,765 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf/16ab0984d9e346c2985bfe3a278ea17e to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/cf/16ab0984d9e346c2985bfe3a278ea17e 2023-07-18 18:10:44,769 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0/recovered.edits/9.seqid 2023-07-18 18:10:44,769 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b/recovered.edits/9.seqid 2023-07-18 18:10:44,770 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/f9f1b9839f3e9c6c9c8fca77e4f56fe0 2023-07-18 18:10:44,770 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportWithTargetName/81f3a3ec389fd85aef0684e97f24ef0b 2023-07-18 18:10:44,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-18 18:10:44,772 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,795 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-18 18:10:44,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-18 18:10:44,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-18 18:10:44,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703844801"}]},"ts":"9223372036854775807"} 2023-07-18 18:10:44,801 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703844801"}]},"ts":"9223372036854775807"} 2023-07-18 18:10:44,803 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:10:44,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f9f1b9839f3e9c6c9c8fca77e4f56fe0, NAME => 'testtb-testExportWithTargetName,,1689703827412.f9f1b9839f3e9c6c9c8fca77e4f56fe0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 81f3a3ec389fd85aef0684e97f24ef0b, NAME => 'testtb-testExportWithTargetName,1,1689703827412.81f3a3ec389fd85aef0684e97f24ef0b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:10:44,803 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-18 18:10:44,804 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703844804"}]},"ts":"9223372036854775807"} 2023-07-18 18:10:44,807 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-18 18:10:44,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 18:10:44,866 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-18 18:10:44,868 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 132 msec 2023-07-18 18:10:45,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-18 18:10:45,062 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-18 18:10:45,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-18 18:10:45,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-18 18:10:45,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-18 18:10:45,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-18 18:10:45,124 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=754 (was 707) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:36533 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:43188 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:42200 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:39913 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-921676158_1 at /127.0.0.1:42180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:34544 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=329 (was 324) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3093 (was 4861) 2023-07-18 18:10:45,124 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-18 18:10:45,148 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=329, ProcessCount=185, AvailableMemoryMB=3092 2023-07-18 18:10:45,148 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-18 18:10:45,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:10:45,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:10:45,155 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:10:45,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-18 18:10:45,156 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:10:45,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:45,159 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,159 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,159 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 empty. 2023-07-18 18:10:45,159 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 empty. 2023-07-18 18:10:45,160 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,160 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,160 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 18:10:45,176 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 18:10:45,177 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => cb0b61908f66949a07b40d9eda3c5f93, NAME => 'testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:10:45,182 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6f3d09da78970cbd6518190a64d8f827, NAME => 'testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:10:45,208 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:45,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing cb0b61908f66949a07b40d9eda3c5f93, disabling compactions & flushes 2023-07-18 18:10:45,209 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. after waiting 0 ms 2023-07-18 18:10:45,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,209 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for cb0b61908f66949a07b40d9eda3c5f93: 2023-07-18 18:10:45,209 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:45,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6f3d09da78970cbd6518190a64d8f827, disabling compactions & flushes 2023-07-18 18:10:45,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. after waiting 0 ms 2023-07-18 18:10:45,210 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,210 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,211 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6f3d09da78970cbd6518190a64d8f827: 2023-07-18 18:10:45,213 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:10:45,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703845214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703845214"}]},"ts":"1689703845214"} 2023-07-18 18:10:45,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703845214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703845214"}]},"ts":"1689703845214"} 2023-07-18 18:10:45,217 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:10:45,218 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:10:45,218 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703845218"}]},"ts":"1689703845218"} 2023-07-18 18:10:45,220 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 18:10:45,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:45,326 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:10:45,327 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:10:45,328 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:10:45,328 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:10:45,328 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:10:45,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, ASSIGN}] 2023-07-18 18:10:45,331 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, ASSIGN 2023-07-18 18:10:45,331 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, ASSIGN 2023-07-18 18:10:45,332 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:10:45,332 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39363,1689703817431; forceNewPlan=false, retain=false 2023-07-18 18:10:45,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:45,483 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:10:45,486 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cb0b61908f66949a07b40d9eda3c5f93, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:45,486 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6f3d09da78970cbd6518190a64d8f827, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:45,486 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703845485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703845485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703845485"}]},"ts":"1689703845485"} 2023-07-18 18:10:45,486 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703845485"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703845485"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703845485"}]},"ts":"1689703845485"} 2023-07-18 18:10:45,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6f3d09da78970cbd6518190a64d8f827, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:10:45,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure cb0b61908f66949a07b40d9eda3c5f93, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:10:45,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f3d09da78970cbd6518190a64d8f827, NAME => 'testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:10:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. service=AccessControlService 2023-07-18 18:10:45,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:45,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cb0b61908f66949a07b40d9eda3c5f93, NAME => 'testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:10:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. service=AccessControlService 2023-07-18 18:10:45,647 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:10:45,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:10:45,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,648 INFO [StoreOpener-6f3d09da78970cbd6518190a64d8f827-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,649 INFO [StoreOpener-cb0b61908f66949a07b40d9eda3c5f93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,650 DEBUG [StoreOpener-6f3d09da78970cbd6518190a64d8f827-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf 2023-07-18 18:10:45,650 DEBUG [StoreOpener-6f3d09da78970cbd6518190a64d8f827-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf 2023-07-18 18:10:45,650 INFO [StoreOpener-6f3d09da78970cbd6518190a64d8f827-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f3d09da78970cbd6518190a64d8f827 columnFamilyName cf 2023-07-18 18:10:45,650 DEBUG [StoreOpener-cb0b61908f66949a07b40d9eda3c5f93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf 2023-07-18 18:10:45,650 DEBUG [StoreOpener-cb0b61908f66949a07b40d9eda3c5f93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf 2023-07-18 18:10:45,651 INFO [StoreOpener-cb0b61908f66949a07b40d9eda3c5f93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cb0b61908f66949a07b40d9eda3c5f93 columnFamilyName cf 2023-07-18 18:10:45,651 INFO [StoreOpener-6f3d09da78970cbd6518190a64d8f827-1] regionserver.HStore(310): Store=6f3d09da78970cbd6518190a64d8f827/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:45,653 INFO [StoreOpener-cb0b61908f66949a07b40d9eda3c5f93-1] regionserver.HStore(310): Store=cb0b61908f66949a07b40d9eda3c5f93/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:10:45,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:10:45,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:10:45,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:45,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f3d09da78970cbd6518190a64d8f827; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60120654, jitterRate=-0.10413244366645813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:45,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f3d09da78970cbd6518190a64d8f827: 2023-07-18 18:10:45,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827., pid=30, masterSystemTime=1689703845641 2023-07-18 18:10:45,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:45,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6f3d09da78970cbd6518190a64d8f827, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:45,670 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703845670"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703845670"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703845670"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703845670"}]},"ts":"1689703845670"} 2023-07-18 18:10:45,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:10:45,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cb0b61908f66949a07b40d9eda3c5f93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60157225, jitterRate=-0.10358749330043793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:10:45,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cb0b61908f66949a07b40d9eda3c5f93: 2023-07-18 18:10:45,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93., pid=31, masterSystemTime=1689703845643 2023-07-18 18:10:45,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-18 18:10:45,677 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6f3d09da78970cbd6518190a64d8f827, server=jenkins-hbase4.apache.org,33749,1689703817568 in 184 msec 2023-07-18 18:10:45,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:45,680 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cb0b61908f66949a07b40d9eda3c5f93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:45,680 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703845680"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703845680"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703845680"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703845680"}]},"ts":"1689703845680"} 2023-07-18 18:10:45,681 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, ASSIGN in 349 msec 2023-07-18 18:10:45,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-18 18:10:45,689 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure cb0b61908f66949a07b40d9eda3c5f93, server=jenkins-hbase4.apache.org,39363,1689703817431 in 193 msec 2023-07-18 18:10:45,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-18 18:10:45,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, ASSIGN in 361 msec 2023-07-18 18:10:45,694 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:10:45,694 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703845694"}]},"ts":"1689703845694"} 2023-07-18 18:10:45,696 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 18:10:45,750 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:10:45,751 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-18 18:10:45,753 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:10:45,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:45,780 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,780 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,780 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,780 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:10:45,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:45,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:45,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:45,811 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:10:45,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 660 msec 2023-07-18 18:10:46,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-18 18:10:46,262 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-18 18:10:46,262 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 18:10:46,262 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:46,266 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 18:10:46,266 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:46,266 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-18 18:10:46,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:46,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703846269 (current time:1689703846269). 2023-07-18 18:10:46,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:46,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x47443d0a to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:46,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c11bfc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:46,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:46,291 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:46,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x47443d0a to 127.0.0.1:55531 2023-07-18 18:10:46,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:46,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x71cc8af0 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:46,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@178645ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:46,351 DEBUG [hconnection-0x6780721-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:46,355 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71cc8af0 to 127.0.0.1:55531 2023-07-18 18:10:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:46,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:10:46,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:46,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:46,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:46,365 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:46,367 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704446367 2023-07-18 18:10:46,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:46,367 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 18:10:46,369 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:46,369 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:46,370 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:46,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:46,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-18 18:10:46,373 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:46,374 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704446374 2023-07-18 18:10:46,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,395 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-18 18:10:46,395 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:46,397 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 18:10:46,397 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:10:46,398 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,398 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,426 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:46,426 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:46,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:46,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:46,426 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:46,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:46,427 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,428 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,428 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 18:10:46,429 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,429 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:46,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-18 18:10:46,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,430 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:46,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:46,441 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:46,441 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:46,441 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:46,441 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:46,442 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:46,444 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:46,447 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:46,469 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:46,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:46,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:46,470 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:46,487 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,670 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:46,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:46,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:46,672 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:46,688 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,688 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:46,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:46,688 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:46,688 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,710 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:46,710 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,711 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:46,711 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:46,711 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b06d5b1[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:46,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:46,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:46,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b06d5b1[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:46,715 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:10:46,715 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:46,749 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:10:46,750 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,750 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:46,750 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:46,750 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:46,750 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. started... 2023-07-18 18:10:46,750 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. started... 2023-07-18 18:10:46,750 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f3d09da78970cbd6518190a64d8f827: 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb0b61908f66949a07b40d9eda3c5f93: 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:46,753 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:10:46,771 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. completed. 2023-07-18 18:10:46,771 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:46,771 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:10:46,773 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. completed. 2023-07-18 18:10:46,774 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:46,774 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:46,774 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:46,774 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,774 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:46,774 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:10:46,780 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:46,780 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:46,780 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:46,818 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:46,818 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:46,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,818 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:46,818 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:46,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:46,820 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:46,818 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:46,818 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:46,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:46,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:46,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:46,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:10:46,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:10:46,829 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-18 18:10:46,829 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:46,829 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:46,829 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,829 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:46,857 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:46,858 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:46,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:46,858 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,859 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:46,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,860 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:46,861 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,861 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:46,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:46,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:46,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:46,895 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:46,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:46,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:46,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:46,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:46,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:46,897 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:46,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:46,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:46,897 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:46,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:46,897 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,897 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:46,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:46,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:46,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,921 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,951 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 18:10:46,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,951 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-18 18:10:46,951 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689703846367Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689703846897 (+530 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689703846897Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689703846902 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689703846914 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689703846951 (+37 ms) 2023-07-18 18:10:46,954 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:46,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 586 msec 2023-07-18 18:10:46,972 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:46,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:46,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:46,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39363] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:46,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33749] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:10:46,988 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-18 18:10:46,988 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:46,989 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:10:47,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703847002 (current time:1689703847002). 2023-07-18 18:10:47,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:10:47,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x0fd0ea7c to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:47,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4bc6d95e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:47,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:47,039 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fd0ea7c to 127.0.0.1:55531 2023-07-18 18:10:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x1a01486c to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:10:47,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f7bf56c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:10:47,091 DEBUG [hconnection-0x49b504b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:10:47,092 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:10:47,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a01486c to 127.0.0.1:55531 2023-07-18 18:10:47,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:10:47,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:10:47,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:10:47,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:47,104 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:47,105 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704447105 2023-07-18 18:10:47,105 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-18 18:10:47,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:10:47,106 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:10:47,107 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:10:47,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:47,109 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:10:47,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-18 18:10:47,113 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:47,114 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704447114 2023-07-18 18:10:47,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-18 18:10:47,129 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-18 18:10:47,129 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,131 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-18 18:10:47,131 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:10:47,149 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,149 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,195 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,195 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,195 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,195 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,196 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,196 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,196 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,196 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 18:10:47,197 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:47,197 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:47,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-18 18:10:47,197 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,197 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,199 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:47,199 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:47,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-18 18:10:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-18 18:10:47,200 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:10:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-18 18:10:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-18 18:10:47,201 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-18 18:10:47,207 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:47,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:47,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:47,208 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:10:47,257 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,257 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,257 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:47,303 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,303 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:10:47,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64094558[Count = 1] remaining members to acquire global barrier 2023-07-18 18:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-18 18:10:47,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64094558[Count = 0] remaining members to acquire global barrier 2023-07-18 18:10:47,310 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:10:47,310 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,349 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:47,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:10:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:47,350 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:10:47,350 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,350 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:10:47,351 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:47,351 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:47,351 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:10:47,351 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. started... 2023-07-18 18:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:47,351 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. started... 2023-07-18 18:10:47,352 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cb0b61908f66949a07b40d9eda3c5f93 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 18:10:47,352 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f3d09da78970cbd6518190a64d8f827 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 18:10:47,368 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/.tmp/cf/ea0b5bf816c540b8b2c1e84531ca89ff 2023-07-18 18:10:47,368 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/.tmp/cf/dfb8d782bbbe4c8aab4b3d93f285b452 2023-07-18 18:10:47,381 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/.tmp/cf/ea0b5bf816c540b8b2c1e84531ca89ff as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf/ea0b5bf816c540b8b2c1e84531ca89ff 2023-07-18 18:10:47,384 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/.tmp/cf/dfb8d782bbbe4c8aab4b3d93f285b452 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf/dfb8d782bbbe4c8aab4b3d93f285b452 2023-07-18 18:10:47,387 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,389 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:47,393 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf/ea0b5bf816c540b8b2c1e84531ca89ff, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 18:10:47,396 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for cb0b61908f66949a07b40d9eda3c5f93 in 45ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:47,396 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-18 18:10:47,396 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf/dfb8d782bbbe4c8aab4b3d93f285b452, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 18:10:47,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cb0b61908f66949a07b40d9eda3c5f93: 2023-07-18 18:10:47,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:47,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:47,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf/ea0b5bf816c540b8b2c1e84531ca89ff] hfiles 2023-07-18 18:10:47,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf/ea0b5bf816c540b8b2c1e84531ca89ff for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:47,397 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 6f3d09da78970cbd6518190a64d8f827 in 46ms, sequenceid=6, compaction requested=false 2023-07-18 18:10:47,399 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f3d09da78970cbd6518190a64d8f827: 2023-07-18 18:10:47,399 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:47,399 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:10:47,399 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf/dfb8d782bbbe4c8aab4b3d93f285b452] hfiles 2023-07-18 18:10:47,399 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf/dfb8d782bbbe4c8aab4b3d93f285b452 for snapshot=snaptb0-testExportFileSystemState 2023-07-18 18:10:47,408 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:47,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:47,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:10:47,410 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:10:47,413 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. completed. 2023-07-18 18:10:47,413 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:10:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:47,413 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:47,414 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:10:47,417 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. completed. 2023-07-18 18:10:47,417 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:10:47,417 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-18 18:10:47,418 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:10:47,498 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,498 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,498 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,499 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-18 18:10:47,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,541 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,541 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-18 18:10:47,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:10:47,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:10:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:10:47,551 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:10:47,551 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-18 18:10:47,551 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:10:47,551 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:10:47,551 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-18 18:10:47,551 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:10:47,564 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,564 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,564 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,564 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:10:47,565 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,565 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,565 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:10:47,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,566 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:10:47,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,568 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:10:47,569 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-18 18:10:47,569 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,595 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,595 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,595 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,595 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-18 18:10:47,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-18 18:10:47,596 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,595 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:10:47,595 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,596 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,597 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,598 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,599 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:10:47,600 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:10:47,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:10:47,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:10:47,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:10:47,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:10:47,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-18 18:10:47,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,668 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689703847105Consolidate snapshot: snaptb0-testExportFileSystemState at 1689703847596 (+491 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689703847596Writing data manifest for snaptb0-testExportFileSystemState at 1689703847604 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689703847616 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689703847667 (+51 ms) 2023-07-18 18:10:47,671 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-18 18:10:47,673 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 565 msec 2023-07-18 18:10:47,710 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:10:47,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:10:47,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:10:47,716 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716 2023-07-18 18:10:47,716 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43971, tgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716, rawTgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:47,740 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:10:47,740 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-535200873_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,740 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-18 18:10:47,749 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-18 18:10:47,814 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,815 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,815 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,816 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,816 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,816 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,817 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,890 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-2048581678846932457.jar 2023-07-18 18:10:47,891 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,891 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,891 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,892 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,892 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,892 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:10:47,893 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:10:47,893 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:10:47,894 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:10:47,894 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:10:47,894 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:10:47,895 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:10:47,895 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:10:47,896 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:10:47,896 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:10:47,897 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:10:47,897 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:47,898 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:47,899 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:47,899 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:47,900 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:10:47,900 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:47,901 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:10:48,650 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:10:48,653 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-18 18:10:48,655 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 18:10:48,774 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0001_000001 (auth:SIMPLE) 2023-07-18 18:10:49,144 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:49,144 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:10:49,340 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0002_000001 (auth:SIMPLE) 2023-07-18 18:10:50,215 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:10:54,210 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0002_000001 (auth:SIMPLE) 2023-07-18 18:10:56,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0002_000001 (auth:SIMPLE) 2023-07-18 18:10:59,157 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0002_000001 (auth:SIMPLE) 2023-07-18 18:11:00,263 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:00,264 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:00,272 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-18 18:11:00,272 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:00,273 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:00,273 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 18:11:00,274 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 18:11:00,274 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 18:11:00,274 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-18 18:11:00,274 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-18 18:11:00,274 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703847716/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-18 18:11:00,282 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-18 18:11:00,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-18 18:11:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 18:11:00,291 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703860291"}]},"ts":"1689703860291"} 2023-07-18 18:11:00,292 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 18:11:00,294 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-18 18:11:00,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, UNASSIGN}] 2023-07-18 18:11:00,298 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, UNASSIGN 2023-07-18 18:11:00,299 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, UNASSIGN 2023-07-18 18:11:00,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6f3d09da78970cbd6518190a64d8f827, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:00,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703860300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703860300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703860300"}]},"ts":"1689703860300"} 2023-07-18 18:11:00,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cb0b61908f66949a07b40d9eda3c5f93, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:00,300 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703860300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703860300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703860300"}]},"ts":"1689703860300"} 2023-07-18 18:11:00,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 6f3d09da78970cbd6518190a64d8f827, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:00,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure cb0b61908f66949a07b40d9eda3c5f93, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:11:00,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 18:11:00,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:11:00,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f3d09da78970cbd6518190a64d8f827, disabling compactions & flushes 2023-07-18 18:11:00,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:11:00,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:11:00,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. after waiting 0 ms 2023-07-18 18:11:00,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:11:00,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:11:00,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cb0b61908f66949a07b40d9eda3c5f93, disabling compactions & flushes 2023-07-18 18:11:00,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:11:00,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:11:00,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. after waiting 0 ms 2023-07-18 18:11:00,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:11:00,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:00,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:00,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827. 2023-07-18 18:11:00,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f3d09da78970cbd6518190a64d8f827: 2023-07-18 18:11:00,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:00,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:00,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93. 2023-07-18 18:11:00,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cb0b61908f66949a07b40d9eda3c5f93: 2023-07-18 18:11:00,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:11:00,475 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6f3d09da78970cbd6518190a64d8f827, regionState=CLOSED 2023-07-18 18:11:00,475 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703860475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703860475"}]},"ts":"1689703860475"} 2023-07-18 18:11:00,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:11:00,477 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=cb0b61908f66949a07b40d9eda3c5f93, regionState=CLOSED 2023-07-18 18:11:00,477 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689703860477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703860477"}]},"ts":"1689703860477"} 2023-07-18 18:11:00,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-18 18:11:00,482 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 6f3d09da78970cbd6518190a64d8f827, server=jenkins-hbase4.apache.org,33749,1689703817568 in 175 msec 2023-07-18 18:11:00,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-18 18:11:00,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure cb0b61908f66949a07b40d9eda3c5f93, server=jenkins-hbase4.apache.org,39363,1689703817431 in 176 msec 2023-07-18 18:11:00,484 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6f3d09da78970cbd6518190a64d8f827, UNASSIGN in 186 msec 2023-07-18 18:11:00,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-18 18:11:00,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=cb0b61908f66949a07b40d9eda3c5f93, UNASSIGN in 187 msec 2023-07-18 18:11:00,486 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703860486"}]},"ts":"1689703860486"} 2023-07-18 18:11:00,487 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 18:11:00,489 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-18 18:11:00,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 207 msec 2023-07-18 18:11:00,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-18 18:11:00,593 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-18 18:11:00,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-18 18:11:00,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,599 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-18 18:11:00,600 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,601 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-18 18:11:00,605 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,605 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,605 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,605 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:00,605 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:00,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:00,606 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-18 18:11:00,607 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:11:00,607 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:11:00,607 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,607 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:00,607 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,607 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,607 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:00,608 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:00,608 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-18 18:11:00,608 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:00,610 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/recovered.edits] 2023-07-18 18:11:00,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 18:11:00,610 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/recovered.edits] 2023-07-18 18:11:00,615 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf/ea0b5bf816c540b8b2c1e84531ca89ff to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/cf/ea0b5bf816c540b8b2c1e84531ca89ff 2023-07-18 18:11:00,616 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf/dfb8d782bbbe4c8aab4b3d93f285b452 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/cf/dfb8d782bbbe4c8aab4b3d93f285b452 2023-07-18 18:11:00,619 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93/recovered.edits/9.seqid 2023-07-18 18:11:00,620 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827/recovered.edits/9.seqid 2023-07-18 18:11:00,620 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/cb0b61908f66949a07b40d9eda3c5f93 2023-07-18 18:11:00,621 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemState/6f3d09da78970cbd6518190a64d8f827 2023-07-18 18:11:00,621 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-18 18:11:00,624 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,627 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-18 18:11:00,629 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-18 18:11:00,631 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,631 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-18 18:11:00,631 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703860631"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:00,631 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703860631"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:00,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:11:00,633 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cb0b61908f66949a07b40d9eda3c5f93, NAME => 'testtb-testExportFileSystemState,,1689703845150.cb0b61908f66949a07b40d9eda3c5f93.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6f3d09da78970cbd6518190a64d8f827, NAME => 'testtb-testExportFileSystemState,1,1689703845150.6f3d09da78970cbd6518190a64d8f827.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:11:00,633 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-18 18:11:00,633 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703860633"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:00,635 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-18 18:11:00,638 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-18 18:11:00,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-18 18:11:00,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-18 18:11:00,712 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-18 18:11:00,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-18 18:11:00,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-18 18:11:00,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-18 18:11:00,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-18 18:11:00,757 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=765 (was 754) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:52794 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:45437 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:33243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_206571861_1 at /127.0.0.1:53326 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1945 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:53358 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:47874 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=922 (was 917) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=403 (was 329) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 185) - ProcessCount LEAK? -, AvailableMemoryMB=2378 (was 3092) 2023-07-18 18:11:00,757 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-18 18:11:00,779 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=403, ProcessCount=186, AvailableMemoryMB=2342 2023-07-18 18:11:00,780 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-18 18:11:00,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:11:00,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:00,786 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:00,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-18 18:11:00,787 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:00,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:00,790 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:00,791 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:00,791 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 empty. 2023-07-18 18:11:00,791 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 empty. 2023-07-18 18:11:00,792 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:00,792 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:00,792 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 18:11:00,810 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:00,815 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 49f30a9f1990af07e0eb2ef60bb00ff0, NAME => 'testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:00,815 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 267a3d7082e0e7d327e496436b8e33d7, NAME => 'testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:00,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:00,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 49f30a9f1990af07e0eb2ef60bb00ff0, disabling compactions & flushes 2023-07-18 18:11:00,841 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:00,841 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:00,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. after waiting 0 ms 2023-07-18 18:11:00,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:00,842 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:00,842 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 49f30a9f1990af07e0eb2ef60bb00ff0: 2023-07-18 18:11:00,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:00,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 267a3d7082e0e7d327e496436b8e33d7, disabling compactions & flushes 2023-07-18 18:11:00,847 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:00,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:00,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. after waiting 0 ms 2023-07-18 18:11:00,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:00,847 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:00,847 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 267a3d7082e0e7d327e496436b8e33d7: 2023-07-18 18:11:00,850 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:00,851 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703860851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703860851"}]},"ts":"1689703860851"} 2023-07-18 18:11:00,851 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703860851"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703860851"}]},"ts":"1689703860851"} 2023-07-18 18:11:00,854 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:00,855 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:00,855 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703860855"}]},"ts":"1689703860855"} 2023-07-18 18:11:00,857 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-18 18:11:00,862 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:00,864 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:00,864 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:00,864 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:00,864 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:00,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, ASSIGN}] 2023-07-18 18:11:00,868 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, ASSIGN 2023-07-18 18:11:00,868 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, ASSIGN 2023-07-18 18:11:00,869 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39363,1689703817431; forceNewPlan=false, retain=false 2023-07-18 18:11:00,869 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:11:00,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:01,019 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:01,023 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=49f30a9f1990af07e0eb2ef60bb00ff0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,023 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=267a3d7082e0e7d327e496436b8e33d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,023 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703861023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703861023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703861023"}]},"ts":"1689703861023"} 2023-07-18 18:11:01,023 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703861023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703861023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703861023"}]},"ts":"1689703861023"} 2023-07-18 18:11:01,026 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 49f30a9f1990af07e0eb2ef60bb00ff0, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:11:01,027 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 267a3d7082e0e7d327e496436b8e33d7, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:01,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:01,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 49f30a9f1990af07e0eb2ef60bb00ff0, NAME => 'testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:11:01,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 267a3d7082e0e7d327e496436b8e33d7, NAME => 'testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:11:01,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. service=AccessControlService 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. service=AccessControlService 2023-07-18 18:11:01,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:01,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,185 INFO [StoreOpener-49f30a9f1990af07e0eb2ef60bb00ff0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,185 INFO [StoreOpener-267a3d7082e0e7d327e496436b8e33d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,186 DEBUG [StoreOpener-49f30a9f1990af07e0eb2ef60bb00ff0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf 2023-07-18 18:11:01,186 DEBUG [StoreOpener-267a3d7082e0e7d327e496436b8e33d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf 2023-07-18 18:11:01,186 DEBUG [StoreOpener-49f30a9f1990af07e0eb2ef60bb00ff0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf 2023-07-18 18:11:01,186 DEBUG [StoreOpener-267a3d7082e0e7d327e496436b8e33d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf 2023-07-18 18:11:01,187 INFO [StoreOpener-267a3d7082e0e7d327e496436b8e33d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 267a3d7082e0e7d327e496436b8e33d7 columnFamilyName cf 2023-07-18 18:11:01,187 INFO [StoreOpener-49f30a9f1990af07e0eb2ef60bb00ff0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49f30a9f1990af07e0eb2ef60bb00ff0 columnFamilyName cf 2023-07-18 18:11:01,188 INFO [StoreOpener-267a3d7082e0e7d327e496436b8e33d7-1] regionserver.HStore(310): Store=267a3d7082e0e7d327e496436b8e33d7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:01,188 INFO [StoreOpener-49f30a9f1990af07e0eb2ef60bb00ff0-1] regionserver.HStore(310): Store=49f30a9f1990af07e0eb2ef60bb00ff0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:01,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:01,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 267a3d7082e0e7d327e496436b8e33d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66162611, jitterRate=-0.014100268483161926}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:01,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 267a3d7082e0e7d327e496436b8e33d7: 2023-07-18 18:11:01,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:01,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7., pid=46, masterSystemTime=1689703861179 2023-07-18 18:11:01,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,199 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=267a3d7082e0e7d327e496436b8e33d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,200 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703861199"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703861199"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703861199"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703861199"}]},"ts":"1689703861199"} 2023-07-18 18:11:01,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-18 18:11:01,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 267a3d7082e0e7d327e496436b8e33d7, server=jenkins-hbase4.apache.org,33749,1689703817568 in 174 msec 2023-07-18 18:11:01,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, ASSIGN in 340 msec 2023-07-18 18:11:01,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:01,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 49f30a9f1990af07e0eb2ef60bb00ff0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68149538, jitterRate=0.015507251024246216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:01,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 49f30a9f1990af07e0eb2ef60bb00ff0: 2023-07-18 18:11:01,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0., pid=45, masterSystemTime=1689703861178 2023-07-18 18:11:01,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,210 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=49f30a9f1990af07e0eb2ef60bb00ff0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,210 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703861210"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703861210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703861210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703861210"}]},"ts":"1689703861210"} 2023-07-18 18:11:01,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-18 18:11:01,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 49f30a9f1990af07e0eb2ef60bb00ff0, server=jenkins-hbase4.apache.org,39363,1689703817431 in 187 msec 2023-07-18 18:11:01,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-18 18:11:01,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, ASSIGN in 350 msec 2023-07-18 18:11:01,217 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:01,217 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703861217"}]},"ts":"1689703861217"} 2023-07-18 18:11:01,219 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-18 18:11:01,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:01,222 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-18 18:11:01,223 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 18:11:01,225 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:01,225 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:01,225 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:01,225 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:01,226 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:01,227 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:01,227 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:01,227 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:01,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 445 msec 2023-07-18 18:11:01,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-18 18:11:01,393 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-18 18:11:01,393 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-18 18:11:01,393 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:01,396 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-18 18:11:01,397 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:01,397 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-18 18:11:01,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:01,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703861400 (current time:1689703861400). 2023-07-18 18:11:01,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:01,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x4086742c to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:01,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5843358a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:01,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:01,411 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:01,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4086742c to 127.0.0.1:55531 2023-07-18 18:11:01,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:01,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x20ce47fa to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:01,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@531a70db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:01,420 DEBUG [hconnection-0x1234e057-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:01,422 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:01,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20ce47fa to 127.0.0.1:55531 2023-07-18 18:11:01,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:01,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 18:11:01,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:01,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:01,432 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:01,433 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689704461433 2023-07-18 18:11:01,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:01,433 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 18:11:01,434 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:01,434 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:01,436 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:01,436 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:01,437 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-18 18:11:01,438 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:01,438 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689704461438 2023-07-18 18:11:01,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,452 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-18 18:11:01,452 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,454 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 18:11:01,454 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 18:11:01,454 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,455 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,457 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,457 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,457 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,457 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,457 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,457 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,458 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,458 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 18:11:01,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:01,459 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,459 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:01,459 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,460 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,462 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,462 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:01,462 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:01,462 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,462 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:01,463 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:01,463 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:01,462 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:01,463 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:01,463 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,463 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:01,470 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:01,472 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,472 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,472 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,472 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,473 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:01,473 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,473 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,473 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,473 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:01,473 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,473 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:01,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:01,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec4259a[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:01,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ec4259a[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:01,479 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 18:11:01,479 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,480 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:01,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,481 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:01,481 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,481 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,481 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:01,481 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. started... 2023-07-18 18:11:01,481 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:01,481 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,481 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. started... 2023-07-18 18:11:01,483 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 267a3d7082e0e7d327e496436b8e33d7: 2023-07-18 18:11:01,484 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 49f30a9f1990af07e0eb2ef60bb00ff0: 2023-07-18 18:11:01,484 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,485 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,486 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:01,486 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:01,486 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:01,486 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:01,491 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:01,491 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,492 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:01,503 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. completed. 2023-07-18 18:11:01,503 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:01,503 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:01,506 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. completed. 2023-07-18 18:11:01,506 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:01,506 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:01,508 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,508 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:01,508 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,508 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:01,510 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:01,510 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,510 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,510 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 18:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:11:01,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 18:11:01,520 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-18 18:11:01,520 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:01,520 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:01,520 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,520 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,522 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,522 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,523 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,523 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,525 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,526 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,526 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,530 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,530 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,531 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,532 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,532 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,533 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,533 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,533 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,533 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,533 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,534 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:01,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:01,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:01,536 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:01,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,576 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 18:11:01,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,577 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:01,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689703861433Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689703861530 (+97 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689703861531 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689703861536 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689703861545 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689703861576 (+31 ms) 2023-07-18 18:11:01,586 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:01,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 152 msec 2023-07-18 18:11:01,736 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:01,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:01,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:01,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33749] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:01,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39363] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:01,751 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-18 18:11:01,751 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,751 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:01,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:01,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703861763 (current time:1689703861763). 2023-07-18 18:11:01,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:01,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x2be96faf to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:01,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61e3af09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:01,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:01,779 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:01,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2be96faf to 127.0.0.1:55531 2023-07-18 18:11:01,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:01,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x4fa3b124 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:01,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fd73b68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:01,788 DEBUG [hconnection-0x53b0527c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:01,791 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:01,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4fa3b124 to 127.0.0.1:55531 2023-07-18 18:11:01,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:01,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-18 18:11:01,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:01,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:01,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:01,800 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:01,800 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689704461800 2023-07-18 18:11:01,800 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-18 18:11:01,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-18 18:11:01,802 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:01,802 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:01,802 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:01,803 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-18 18:11:01,804 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-18 18:11:01,805 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:01,806 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689704461806 2023-07-18 18:11:01,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-18 18:11:01,816 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-18 18:11:01,817 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,818 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-18 18:11:01,818 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-18 18:11:01,819 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,819 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,820 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,820 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,820 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,821 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,821 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,821 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,821 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 18:11:01,822 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,822 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:01,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,822 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:01,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 18:11:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,823 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-18 18:11:01,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,823 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-18 18:11:01,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 18:11:01,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 18:11:01,824 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:01,824 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:01,824 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,824 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-18 18:11:01,826 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:01,825 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:01,826 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:01,826 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:01,826 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:01,826 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-18 18:11:01,827 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:01,827 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:01,827 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-18 18:11:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-18 18:11:01,828 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-18 18:11:01,829 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,829 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,830 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,830 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:01,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,831 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,831 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:01,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9f30a[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-18 18:11:01,835 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56e9f30a[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:01,835 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-18 18:11:01,835 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:01,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:01,838 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:01,838 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,837 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,838 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. started... 2023-07-18 18:11:01,838 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:01,838 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:01,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,838 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:01,838 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 49f30a9f1990af07e0eb2ef60bb00ff0 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-18 18:11:01,838 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-18 18:11:01,838 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,838 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,840 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:01,844 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:01,844 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,844 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:01,844 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. started... 2023-07-18 18:11:01,844 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 267a3d7082e0e7d327e496436b8e33d7 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-18 18:11:01,856 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/.tmp/cf/09c49040d41c48d199550c381d591a22 2023-07-18 18:11:01,856 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/.tmp/cf/11133b5143d74ab8b636da3ca80cd949 2023-07-18 18:11:01,861 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/.tmp/cf/11133b5143d74ab8b636da3ca80cd949 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf/11133b5143d74ab8b636da3ca80cd949 2023-07-18 18:11:01,861 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/.tmp/cf/09c49040d41c48d199550c381d591a22 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf/09c49040d41c48d199550c381d591a22 2023-07-18 18:11:01,867 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf/09c49040d41c48d199550c381d591a22, entries=4, sequenceid=6, filesize=5.1 K 2023-07-18 18:11:01,867 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf/11133b5143d74ab8b636da3ca80cd949, entries=46, sequenceid=6, filesize=7.9 K 2023-07-18 18:11:01,868 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 267a3d7082e0e7d327e496436b8e33d7 in 24ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:01,868 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 18:11:01,868 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 49f30a9f1990af07e0eb2ef60bb00ff0 in 30ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:01,868 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 267a3d7082e0e7d327e496436b8e33d7: 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 49f30a9f1990af07e0eb2ef60bb00ff0: 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf/09c49040d41c48d199550c381d591a22] hfiles 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf/09c49040d41c48d199550c381d591a22 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf/11133b5143d74ab8b636da3ca80cd949] hfiles 2023-07-18 18:11:01,870 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf/11133b5143d74ab8b636da3ca80cd949 for snapshot=snaptb0-testConsecutiveExports 2023-07-18 18:11:01,880 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. completed. 2023-07-18 18:11:01,880 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:01,880 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. completed. 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:01,880 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:01,880 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:01,882 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:01,882 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,882 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,882 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:01,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,887 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-18 18:11:01,887 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,887 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,887 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-18 18:11:01,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:11:01,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-18 18:11:01,895 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-18 18:11:01,895 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:01,895 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:01,895 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-18 18:11:01,895 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,898 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:01,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,898 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:01,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:01,899 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,900 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,901 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:01,902 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-18 18:11:01,902 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:01,902 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:01,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,903 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,911 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-18 18:11:01,911 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:01,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-18 18:11:01,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:01,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,911 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:01,913 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,913 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:01,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:01,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:01,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:01,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,952 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-18 18:11:01,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,952 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:01,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689703861801Consolidate snapshot: snaptb0-testConsecutiveExports at 1689703861912 (+111 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689703861912Writing data manifest for snaptb0-testConsecutiveExports at 1689703861917 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689703861927 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689703861952 (+25 ms) 2023-07-18 18:11:01,955 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-18 18:11:01,956 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 154 msec 2023-07-18 18:11:02,104 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:02,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-18 18:11:02,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:02,105 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105 2023-07-18 18:11:02,106 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:02,133 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:02,134 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7fc88b3c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:02,134 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 18:11:02,143 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:02,166 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,166 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,167 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,168 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,168 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,169 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,169 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,240 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-7098270479355608717.jar 2023-07-18 18:11:02,240 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,241 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,242 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,242 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,242 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,243 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:02,243 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:02,244 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:02,244 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:02,244 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:02,245 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:02,245 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:02,245 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:02,246 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:02,246 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:02,247 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:02,247 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:02,247 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:02,248 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:02,248 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:02,248 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:02,248 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:02,249 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:03,055 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:11:03,058 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 18:11:03,061 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 18:11:05,343 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:05,344 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:05,350 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0002_000001 (auth:SIMPLE) 2023-07-18 18:11:05,780 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:06,052 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:11:10,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:12,338 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:15,515 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:17,334 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:17,335 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:17,339 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 18:11:17,339 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:17,340 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:17,340 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:17,341 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:17,341 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:17,341 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@30f835ce in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:17,342 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:17,342 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:17,343 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:17,375 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:17,376 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@16594427, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:17,376 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-18 18:11:17,403 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-18 18:11:17,422 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,423 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,424 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,424 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,425 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,425 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,426 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,504 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-579757219561848383.jar 2023-07-18 18:11:17,505 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,505 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,506 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,506 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,506 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,507 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:17,507 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:17,508 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:17,508 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:17,509 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:17,509 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:17,509 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:17,510 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:17,510 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:17,510 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:17,511 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:17,511 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:17,511 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:17,512 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:17,512 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:17,512 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:17,513 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:17,513 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:17,873 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:11:17,875 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-18 18:11:17,877 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 18:11:21,705 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:21,705 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:21,708 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0003_000001 (auth:SIMPLE) 2023-07-18 18:11:22,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:26,760 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:29,039 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:31,593 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:33,172 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:33,172 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:33,189 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-18 18:11:33,189 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:33,190 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:33,190 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:33,204 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:33,205 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:33,205 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@30f835ce in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-18 18:11:33,205 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-18 18:11:33,205 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/local-export-1689703862105/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-18 18:11:33,228 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-18 18:11:33,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-18 18:11:33,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:33,239 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703893239"}]},"ts":"1689703893239"} 2023-07-18 18:11:33,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:33,248 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-18 18:11:33,251 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-18 18:11:33,252 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, UNASSIGN}] 2023-07-18 18:11:33,261 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, UNASSIGN 2023-07-18 18:11:33,261 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, UNASSIGN 2023-07-18 18:11:33,263 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=49f30a9f1990af07e0eb2ef60bb00ff0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:33,263 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=267a3d7082e0e7d327e496436b8e33d7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:33,263 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703893263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703893263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703893263"}]},"ts":"1689703893263"} 2023-07-18 18:11:33,263 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703893263"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703893263"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703893263"}]},"ts":"1689703893263"} 2023-07-18 18:11:33,265 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 49f30a9f1990af07e0eb2ef60bb00ff0, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:11:33,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 267a3d7082e0e7d327e496436b8e33d7, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:33,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:33,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:33,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 49f30a9f1990af07e0eb2ef60bb00ff0, disabling compactions & flushes 2023-07-18 18:11:33,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:33,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:33,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. after waiting 0 ms 2023-07-18 18:11:33,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:33,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 267a3d7082e0e7d327e496436b8e33d7, disabling compactions & flushes 2023-07-18 18:11:33,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. after waiting 0 ms 2023-07-18 18:11:33,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:33,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:33,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:33,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:33,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:33,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7. 2023-07-18 18:11:33,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 267a3d7082e0e7d327e496436b8e33d7: 2023-07-18 18:11:33,528 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=267a3d7082e0e7d327e496436b8e33d7, regionState=CLOSED 2023-07-18 18:11:33,528 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703893528"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703893528"}]},"ts":"1689703893528"} 2023-07-18 18:11:33,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:33,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0. 2023-07-18 18:11:33,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 49f30a9f1990af07e0eb2ef60bb00ff0: 2023-07-18 18:11:33,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:33,533 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=49f30a9f1990af07e0eb2ef60bb00ff0, regionState=CLOSED 2023-07-18 18:11:33,534 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689703893533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703893533"}]},"ts":"1689703893533"} 2023-07-18 18:11:33,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-18 18:11:33,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 267a3d7082e0e7d327e496436b8e33d7, server=jenkins-hbase4.apache.org,33749,1689703817568 in 265 msec 2023-07-18 18:11:33,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=267a3d7082e0e7d327e496436b8e33d7, UNASSIGN in 283 msec 2023-07-18 18:11:33,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-18 18:11:33,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 49f30a9f1990af07e0eb2ef60bb00ff0, server=jenkins-hbase4.apache.org,39363,1689703817431 in 271 msec 2023-07-18 18:11:33,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-18 18:11:33,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=49f30a9f1990af07e0eb2ef60bb00ff0, UNASSIGN in 287 msec 2023-07-18 18:11:33,543 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703893543"}]},"ts":"1689703893543"} 2023-07-18 18:11:33,545 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-18 18:11:33,547 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-18 18:11:33,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:33,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 319 msec 2023-07-18 18:11:33,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-18 18:11:33,852 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-18 18:11:33,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-18 18:11:33,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:33,858 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-18 18:11:33,859 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:33,863 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-18 18:11:33,866 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,866 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,867 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,867 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,867 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:33,867 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:33,868 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-18 18:11:33,873 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:33,873 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-18 18:11:33,873 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,873 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,874 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:33,873 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-18 18:11:33,873 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-18 18:11:33,874 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:33,874 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:33,875 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:33,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 18:11:33,886 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/recovered.edits] 2023-07-18 18:11:33,903 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:33,911 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/recovered.edits] 2023-07-18 18:11:33,919 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf/09c49040d41c48d199550c381d591a22 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/cf/09c49040d41c48d199550c381d591a22 2023-07-18 18:11:33,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7/recovered.edits/9.seqid 2023-07-18 18:11:33,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf/11133b5143d74ab8b636da3ca80cd949 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/cf/11133b5143d74ab8b636da3ca80cd949 2023-07-18 18:11:33,928 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/267a3d7082e0e7d327e496436b8e33d7 2023-07-18 18:11:33,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0/recovered.edits/9.seqid 2023-07-18 18:11:33,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testConsecutiveExports/49f30a9f1990af07e0eb2ef60bb00ff0 2023-07-18 18:11:33,932 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-18 18:11:33,941 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:33,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 18:11:33,980 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-18 18:11:33,987 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-18 18:11:33,989 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:33,989 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-18 18:11:33,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703893989"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:33,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703893989"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:33,997 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:11:33,997 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 267a3d7082e0e7d327e496436b8e33d7, NAME => 'testtb-testConsecutiveExports,,1689703860781.267a3d7082e0e7d327e496436b8e33d7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 49f30a9f1990af07e0eb2ef60bb00ff0, NAME => 'testtb-testConsecutiveExports,1,1689703860781.49f30a9f1990af07e0eb2ef60bb00ff0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:11:33,998 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-18 18:11:33,998 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703893998"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:34,001 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-18 18:11:34,004 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-18 18:11:34,006 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 151 msec 2023-07-18 18:11:34,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-18 18:11:34,178 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-18 18:11:34,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-18 18:11:34,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-18 18:11:34,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-18 18:11:34,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-18 18:11:34,242 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=745 (was 765), OpenFileDescriptor=896 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=476 (was 403) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 186) - ProcessCount LEAK? -, AvailableMemoryMB=2684 (was 2342) - AvailableMemoryMB LEAK? - 2023-07-18 18:11:34,243 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-18 18:11:34,271 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=745, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=476, ProcessCount=190, AvailableMemoryMB=2681 2023-07-18 18:11:34,271 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=745 is superior to 500 2023-07-18 18:11:34,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:11:34,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:34,279 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:34,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-18 18:11:34,280 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:34,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:34,285 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,291 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,307 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef empty. 2023-07-18 18:11:34,308 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 empty. 2023-07-18 18:11:34,308 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,308 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,309 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 18:11:34,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:34,390 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:34,392 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1069b7aed824acc44267f2c7cf2313ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:34,395 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 58a898948602532090f9e65556a5c9d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:34,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:34,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 1069b7aed824acc44267f2c7cf2313ef, disabling compactions & flushes 2023-07-18 18:11:34,483 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,483 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. after waiting 0 ms 2023-07-18 18:11:34,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,484 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,484 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 1069b7aed824acc44267f2c7cf2313ef: 2023-07-18 18:11:34,490 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:34,490 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 58a898948602532090f9e65556a5c9d6, disabling compactions & flushes 2023-07-18 18:11:34,491 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,491 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,491 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. after waiting 0 ms 2023-07-18 18:11:34,491 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,491 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,491 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 58a898948602532090f9e65556a5c9d6: 2023-07-18 18:11:34,500 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:34,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703894501"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703894501"}]},"ts":"1689703894501"} 2023-07-18 18:11:34,501 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703894501"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703894501"}]},"ts":"1689703894501"} 2023-07-18 18:11:34,522 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:34,523 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:34,524 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703894524"}]},"ts":"1689703894524"} 2023-07-18 18:11:34,526 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-18 18:11:34,536 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:34,537 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:34,537 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:34,538 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:34,538 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:34,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, ASSIGN}] 2023-07-18 18:11:34,541 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, ASSIGN 2023-07-18 18:11:34,541 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, ASSIGN 2023-07-18 18:11:34,542 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39363,1689703817431; forceNewPlan=false, retain=false 2023-07-18 18:11:34,542 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38743,1689703817702; forceNewPlan=false, retain=false 2023-07-18 18:11:34,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:34,692 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:34,696 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=58a898948602532090f9e65556a5c9d6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:34,696 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703894696"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703894696"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703894696"}]},"ts":"1689703894696"} 2023-07-18 18:11:34,697 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1069b7aed824acc44267f2c7cf2313ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:34,697 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703894697"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703894697"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703894697"}]},"ts":"1689703894697"} 2023-07-18 18:11:34,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 58a898948602532090f9e65556a5c9d6, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:11:34,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 1069b7aed824acc44267f2c7cf2313ef, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:11:34,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 58a898948602532090f9e65556a5c9d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:11:34,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. service=AccessControlService 2023-07-18 18:11:34,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:34,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:34,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,864 INFO [StoreOpener-58a898948602532090f9e65556a5c9d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,866 DEBUG [StoreOpener-58a898948602532090f9e65556a5c9d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf 2023-07-18 18:11:34,866 DEBUG [StoreOpener-58a898948602532090f9e65556a5c9d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf 2023-07-18 18:11:34,867 INFO [StoreOpener-58a898948602532090f9e65556a5c9d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 58a898948602532090f9e65556a5c9d6 columnFamilyName cf 2023-07-18 18:11:34,868 INFO [StoreOpener-58a898948602532090f9e65556a5c9d6-1] regionserver.HStore(310): Store=58a898948602532090f9e65556a5c9d6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:34,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1069b7aed824acc44267f2c7cf2313ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:11:34,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. service=AccessControlService 2023-07-18 18:11:34,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,871 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:34,871 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:34,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,872 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:34,881 INFO [StoreOpener-1069b7aed824acc44267f2c7cf2313ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,883 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:34,884 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 58a898948602532090f9e65556a5c9d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62356377, jitterRate=-0.07081757485866547}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:34,884 DEBUG [StoreOpener-1069b7aed824acc44267f2c7cf2313ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf 2023-07-18 18:11:34,884 DEBUG [StoreOpener-1069b7aed824acc44267f2c7cf2313ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf 2023-07-18 18:11:34,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 58a898948602532090f9e65556a5c9d6: 2023-07-18 18:11:34,885 INFO [StoreOpener-1069b7aed824acc44267f2c7cf2313ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1069b7aed824acc44267f2c7cf2313ef columnFamilyName cf 2023-07-18 18:11:34,886 INFO [StoreOpener-1069b7aed824acc44267f2c7cf2313ef-1] regionserver.HStore(310): Store=1069b7aed824acc44267f2c7cf2313ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:34,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:34,891 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6., pid=60, masterSystemTime=1689703894852 2023-07-18 18:11:34,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:34,896 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=58a898948602532090f9e65556a5c9d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:34,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703894896"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703894896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703894896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703894896"}]},"ts":"1689703894896"} 2023-07-18 18:11:34,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:34,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-18 18:11:34,901 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 58a898948602532090f9e65556a5c9d6, server=jenkins-hbase4.apache.org,39363,1689703817431 in 199 msec 2023-07-18 18:11:34,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, ASSIGN in 363 msec 2023-07-18 18:11:34,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:34,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1069b7aed824acc44267f2c7cf2313ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69231455, jitterRate=0.03162907063961029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:34,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1069b7aed824acc44267f2c7cf2313ef: 2023-07-18 18:11:34,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef., pid=61, masterSystemTime=1689703894854 2023-07-18 18:11:34,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:34,915 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=1069b7aed824acc44267f2c7cf2313ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:34,915 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703894915"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703894915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703894915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703894915"}]},"ts":"1689703894915"} 2023-07-18 18:11:34,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-18 18:11:34,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 1069b7aed824acc44267f2c7cf2313ef, server=jenkins-hbase4.apache.org,38743,1689703817702 in 217 msec 2023-07-18 18:11:34,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-18 18:11:34,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, ASSIGN in 381 msec 2023-07-18 18:11:34,923 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:34,923 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703894923"}]},"ts":"1689703894923"} 2023-07-18 18:11:34,925 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-18 18:11:34,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:34,928 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-18 18:11:34,930 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 18:11:34,932 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:34,932 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:34,932 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:34,933 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:34,936 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:34,936 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:34,936 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:34,936 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:34,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:34,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:34,938 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:34,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 665 msec 2023-07-18 18:11:35,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-18 18:11:35,393 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-18 18:11:35,393 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-18 18:11:35,394 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:35,398 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-18 18:11:35,398 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:35,398 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-18 18:11:35,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:35,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703895407 (current time:1689703895407). 2023-07-18 18:11:35,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:35,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x4bc0a184 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:35,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35566d14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:35,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:35,437 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:35,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bc0a184 to 127.0.0.1:55531 2023-07-18 18:11:35,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:35,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x34e412ae to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:35,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a665937, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:35,479 DEBUG [hconnection-0x7c5ea5a2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:35,481 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:35,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x34e412ae to 127.0.0.1:55531 2023-07-18 18:11:35,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:35,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 18:11:35,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:35,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:35,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:35,507 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:35,510 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689704495510 2023-07-18 18:11:35,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:35,510 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:35,510 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:35,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:35,521 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:35,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 17 msec 2023-07-18 18:11:35,529 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:35,532 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689704495532 2023-07-18 18:11:35,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,595 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 18:11:35,595 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:35,597 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 18:11:35,597 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 18:11:35,598 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,598 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,599 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:35,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:35,600 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:35,600 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:35,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:35,600 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:35,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:35,602 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:35,603 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,603 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,603 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,603 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:35,606 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,607 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:35,607 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:35,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,611 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:35,611 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:35,613 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:35,612 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:35,615 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:35,614 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:35,615 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:35,615 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:35,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:35,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:35,617 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:35,617 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:35,617 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:35,618 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:35,623 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,623 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,623 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,623 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,623 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:35,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:35,624 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,624 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:35,624 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,624 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:35,624 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,624 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:35,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:35,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:35,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:35,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:35,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bcf0f3b[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:35,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:35,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:35,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:35,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:35,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:35,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:35,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bcf0f3b[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:35,634 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 18:11:35,634 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:35,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,636 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:35,636 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:35,636 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:35,636 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,636 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:35,637 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,637 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:35,641 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:35,641 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. started... 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:35,641 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:35,641 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:35,642 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. started... 2023-07-18 18:11:35,644 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 58a898948602532090f9e65556a5c9d6: 2023-07-18 18:11:35,644 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,644 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:35,644 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1069b7aed824acc44267f2c7cf2313ef: 2023-07-18 18:11:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:35,645 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:35,672 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. completed. 2023-07-18 18:11:35,672 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:35,672 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:35,675 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,675 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:35,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:35,675 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. completed. 2023-07-18 18:11:35,675 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:35,675 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:35,675 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:35,677 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:35,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:35,679 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:35,679 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:35,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,679 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:11:35,685 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 18:11:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:35,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:35,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:35,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38743,1689703817702': 2023-07-18 18:11:35,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 18:11:35,707 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 18:11:35,707 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:35,707 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:35,707 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,707 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:35,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:35,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:35,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:35,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:35,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:35,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:35,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:35,712 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,713 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:35,714 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:35,716 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,716 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,717 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,727 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:35,727 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:35,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:35,727 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:35,727 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:35,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:35,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:35,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:35,727 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:35,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:35,727 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:35,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:35,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:35,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:35,730 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,730 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,730 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,730 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,730 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:35,730 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:35,730 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,732 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:35,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,732 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:35,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:35,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:35,732 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:35,732 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:35,732 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,732 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,818 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:35,820 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:35,827 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 18:11:35,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,827 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:35,827 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689703895510Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703895732 (+222 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703895732Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703895747 (+15 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689703895768 (+21 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689703895827 (+59 ms) 2023-07-18 18:11:35,831 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:35,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 315 msec 2023-07-18 18:11:36,120 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:36,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:36,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38743] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:36,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39363] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:36,149 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,149 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:36,151 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:36,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:36,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703896189 (current time:1689703896189). 2023-07-18 18:11:36,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:36,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x68105804 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:36,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@136e4db3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:36,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:36,261 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51768, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:36,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68105804 to 127.0.0.1:55531 2023-07-18 18:11:36,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:36,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x61a40e47 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:36,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b1eba0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:36,279 DEBUG [hconnection-0x6afc7d0a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:36,283 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:36,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61a40e47 to 127.0.0.1:55531 2023-07-18 18:11:36,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:36,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-18 18:11:36,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:36,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:36,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:36,301 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:36,302 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689704496302 2023-07-18 18:11:36,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-18 18:11:36,302 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,305 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-18 18:11:36,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:36,306 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:36,306 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:36,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-18 18:11:36,308 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:36,308 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689704496308 2023-07-18 18:11:36,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,326 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-18 18:11:36,326 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:36,328 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-18 18:11:36,328 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-18 18:11:36,329 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,329 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,335 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:36,335 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:36,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:36,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:36,335 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,335 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:36,336 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,336 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 18:11:36,337 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,337 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-18 18:11:36,337 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:36,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,338 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-18 18:11:36,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,342 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:36,342 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:36,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,343 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:36,343 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:36,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,343 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-18 18:11:36,343 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:36,346 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:36,346 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-18 18:11:36,347 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:36,347 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:36,347 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-18 18:11:36,347 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-18 18:11:36,348 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,348 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:36,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:36,349 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,349 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:36,351 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,351 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:36,352 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,352 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:36,352 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:36,352 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,352 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:36,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:36,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:36,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:36,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c2b29f[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:36,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:36,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:36,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:36,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:36,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-18 18:11:36,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75c2b29f[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:36,363 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-18 18:11:36,363 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:36,365 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:36,365 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:36,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,366 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:36,366 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-18 18:11:36,367 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:36,367 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:36,367 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:36,368 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,369 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,369 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:36,370 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:36,371 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:36,372 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:36,372 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. started... 2023-07-18 18:11:36,373 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 58a898948602532090f9e65556a5c9d6 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-18 18:11:36,379 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:36,379 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:36,379 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:36,379 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. started... 2023-07-18 18:11:36,379 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1069b7aed824acc44267f2c7cf2313ef 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-18 18:11:36,398 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/.tmp/cf/165fc2ee917243fb8429612154a2170d 2023-07-18 18:11:36,400 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/.tmp/cf/661586203276459cb1052908c5486bf3 2023-07-18 18:11:36,404 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/.tmp/cf/165fc2ee917243fb8429612154a2170d as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf/165fc2ee917243fb8429612154a2170d 2023-07-18 18:11:36,405 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/.tmp/cf/661586203276459cb1052908c5486bf3 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf/661586203276459cb1052908c5486bf3 2023-07-18 18:11:36,406 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:36,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:36,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:36,407 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:36,410 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf/165fc2ee917243fb8429612154a2170d, entries=45, sequenceid=6, filesize=7.9 K 2023-07-18 18:11:36,411 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 58a898948602532090f9e65556a5c9d6 in 38ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:36,411 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-18 18:11:36,411 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf/661586203276459cb1052908c5486bf3, entries=5, sequenceid=6, filesize=5.2 K 2023-07-18 18:11:36,411 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 58a898948602532090f9e65556a5c9d6: 2023-07-18 18:11:36,411 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,411 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:36,411 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf/165fc2ee917243fb8429612154a2170d] hfiles 2023-07-18 18:11:36,411 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf/165fc2ee917243fb8429612154a2170d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,412 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 1069b7aed824acc44267f2c7cf2313ef in 33ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:36,413 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1069b7aed824acc44267f2c7cf2313ef: 2023-07-18 18:11:36,413 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,414 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:36,414 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf/661586203276459cb1052908c5486bf3] hfiles 2023-07-18 18:11:36,414 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf/661586203276459cb1052908c5486bf3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,607 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:36,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:36,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:36,609 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:36,844 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. completed. 2023-07-18 18:11:36,844 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. completed. 2023-07-18 18:11:36,844 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:36,844 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:36,844 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:36,845 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,845 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-18 18:11:36,845 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:36,876 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,876 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:36,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:36,876 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:36,877 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:36,899 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-18 18:11:36,899 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:36,899 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:36,900 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-18 18:11:36,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:36,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:36,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38743,1689703817702': 2023-07-18 18:11:36,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-18 18:11:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:36,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:36,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:36,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:11:36,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-18 18:11:36,909 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-18 18:11:36,909 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:36,909 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:36,909 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:36,909 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:36,910 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:36,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:36,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:36,911 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:11:37,048 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:37,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:37,048 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,049 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,048 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:37,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,049 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:37,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:37,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:37,050 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,051 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:37,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:37,054 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,055 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,055 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:37,084 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:37,084 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:37,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:37,084 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:37,085 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,084 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:37,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:37,085 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:37,085 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,085 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:37,085 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:37,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:37,084 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:37,085 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,087 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:37,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:37,087 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,087 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:37,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,087 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:37,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:37,088 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,088 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,088 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,088 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:37,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:37,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,160 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-18 18:11:37,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,161 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:37,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689703896302Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689703897085 (+783 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689703897085Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689703897092 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689703897105 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689703897160 (+55 ms) 2023-07-18 18:11:37,164 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-18 18:11:37,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 861 msec 2023-07-18 18:11:37,411 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:37,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-18 18:11:37,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:37,451 DEBUG [Listener at jenkins-hbase4.apache.org/45437] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:37,454 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52142, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:37,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33749] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 18:11:37,456 DEBUG [Listener at jenkins-hbase4.apache.org/45437] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:37,461 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:37,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38743] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 18:11:37,462 DEBUG [Listener at jenkins-hbase4.apache.org/45437] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-18 18:11:37,465 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-18 18:11:37,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39363] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-18 18:11:37,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:11:37,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:37,471 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:37,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-18 18:11:37,472 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:37,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:37,474 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:37,474 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:37,475 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e empty. 2023-07-18 18:11:37,475 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 empty. 2023-07-18 18:11:37,475 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:37,476 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:37,476 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 18:11:37,546 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:37,548 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6bc50086d58ee4d3e31c93650b91e68e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:37,548 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6359261b56d58eb2cdffc8517e6ccb35, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:37,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:37,630 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:37,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 6bc50086d58ee4d3e31c93650b91e68e, disabling compactions & flushes 2023-07-18 18:11:37,631 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:37,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:37,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. after waiting 0 ms 2023-07-18 18:11:37,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:37,631 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:37,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 6bc50086d58ee4d3e31c93650b91e68e: 2023-07-18 18:11:37,689 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:37,690 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 6359261b56d58eb2cdffc8517e6ccb35, disabling compactions & flushes 2023-07-18 18:11:37,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:37,690 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:37,690 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. after waiting 0 ms 2023-07-18 18:11:37,690 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:37,690 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:37,690 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 6359261b56d58eb2cdffc8517e6ccb35: 2023-07-18 18:11:37,726 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:37,728 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703897728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703897728"}]},"ts":"1689703897728"} 2023-07-18 18:11:37,728 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703897728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703897728"}]},"ts":"1689703897728"} 2023-07-18 18:11:37,733 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:37,735 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0004_000001 (auth:SIMPLE) 2023-07-18 18:11:37,753 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:37,753 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703897753"}]},"ts":"1689703897753"} 2023-07-18 18:11:37,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:37,778 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-18 18:11:37,823 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:37,824 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:37,824 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:37,824 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:37,824 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:37,824 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, ASSIGN}] 2023-07-18 18:11:37,827 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, ASSIGN 2023-07-18 18:11:37,828 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, ASSIGN 2023-07-18 18:11:37,829 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38743,1689703817702; forceNewPlan=false, retain=false 2023-07-18 18:11:37,829 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:11:37,979 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:37,982 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6bc50086d58ee4d3e31c93650b91e68e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:37,982 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6359261b56d58eb2cdffc8517e6ccb35, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:37,982 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703897982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703897982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703897982"}]},"ts":"1689703897982"} 2023-07-18 18:11:37,982 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703897982"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703897982"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703897982"}]},"ts":"1689703897982"} 2023-07-18 18:11:37,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 6bc50086d58ee4d3e31c93650b91e68e, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:37,985 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 6359261b56d58eb2cdffc8517e6ccb35, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:11:38,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:38,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bc50086d58ee4d3e31c93650b91e68e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.', STARTKEY => '', ENDKEY => '2'} 2023-07-18 18:11:38,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6359261b56d58eb2cdffc8517e6ccb35, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.', STARTKEY => '2', ENDKEY => ''} 2023-07-18 18:11:38,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. service=AccessControlService 2023-07-18 18:11:38,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. service=AccessControlService 2023-07-18 18:11:38,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:38,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,143 INFO [StoreOpener-6bc50086d58ee4d3e31c93650b91e68e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,143 INFO [StoreOpener-6359261b56d58eb2cdffc8517e6ccb35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,145 DEBUG [StoreOpener-6359261b56d58eb2cdffc8517e6ccb35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf 2023-07-18 18:11:38,145 DEBUG [StoreOpener-6359261b56d58eb2cdffc8517e6ccb35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf 2023-07-18 18:11:38,145 DEBUG [StoreOpener-6bc50086d58ee4d3e31c93650b91e68e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf 2023-07-18 18:11:38,145 DEBUG [StoreOpener-6bc50086d58ee4d3e31c93650b91e68e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf 2023-07-18 18:11:38,145 INFO [StoreOpener-6359261b56d58eb2cdffc8517e6ccb35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6359261b56d58eb2cdffc8517e6ccb35 columnFamilyName cf 2023-07-18 18:11:38,145 INFO [StoreOpener-6bc50086d58ee4d3e31c93650b91e68e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bc50086d58ee4d3e31c93650b91e68e columnFamilyName cf 2023-07-18 18:11:38,146 INFO [StoreOpener-6359261b56d58eb2cdffc8517e6ccb35-1] regionserver.HStore(310): Store=6359261b56d58eb2cdffc8517e6ccb35/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:38,146 INFO [StoreOpener-6bc50086d58ee4d3e31c93650b91e68e-1] regionserver.HStore(310): Store=6bc50086d58ee4d3e31c93650b91e68e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:38,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:38,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:38,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bc50086d58ee4d3e31c93650b91e68e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60024294, jitterRate=-0.10556831955909729}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:38,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bc50086d58ee4d3e31c93650b91e68e: 2023-07-18 18:11:38,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6359261b56d58eb2cdffc8517e6ccb35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70866673, jitterRate=0.05599571764469147}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:38,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6359261b56d58eb2cdffc8517e6ccb35: 2023-07-18 18:11:38,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e., pid=69, masterSystemTime=1689703898136 2023-07-18 18:11:38,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35., pid=70, masterSystemTime=1689703898136 2023-07-18 18:11:38,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6bc50086d58ee4d3e31c93650b91e68e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:38,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,156 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703898156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703898156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703898156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703898156"}]},"ts":"1689703898156"} 2023-07-18 18:11:38,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,156 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6359261b56d58eb2cdffc8517e6ccb35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:38,157 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703898156"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703898156"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703898156"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703898156"}]},"ts":"1689703898156"} 2023-07-18 18:11:38,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-18 18:11:38,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 6bc50086d58ee4d3e31c93650b91e68e, server=jenkins-hbase4.apache.org,33749,1689703817568 in 173 msec 2023-07-18 18:11:38,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-18 18:11:38,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 6359261b56d58eb2cdffc8517e6ccb35, server=jenkins-hbase4.apache.org,38743,1689703817702 in 173 msec 2023-07-18 18:11:38,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, ASSIGN in 335 msec 2023-07-18 18:11:38,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-18 18:11:38,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, ASSIGN in 336 msec 2023-07-18 18:11:38,168 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:38,168 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703898168"}]},"ts":"1689703898168"} 2023-07-18 18:11:38,169 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-18 18:11:38,172 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:38,172 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-18 18:11:38,174 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 18:11:38,176 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:38,176 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:38,176 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:38,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,179 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,180 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,180 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 710 msec 2023-07-18 18:11:38,183 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:38,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:38,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-18 18:11:38,578 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-18 18:11:38,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 6bc50086d58ee4d3e31c93650b91e68e, 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6bc50086d58ee4d3e31c93650b91e68e, 6359261b56d58eb2cdffc8517e6ccb35], force=true 2023-07-18 18:11:38,637 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6bc50086d58ee4d3e31c93650b91e68e, 6359261b56d58eb2cdffc8517e6ccb35], force=true 2023-07-18 18:11:38,637 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6bc50086d58ee4d3e31c93650b91e68e, 6359261b56d58eb2cdffc8517e6ccb35], force=true 2023-07-18 18:11:38,637 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6bc50086d58ee4d3e31c93650b91e68e, 6359261b56d58eb2cdffc8517e6ccb35], force=true 2023-07-18 18:11:38,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:38,664 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, UNASSIGN}] 2023-07-18 18:11:38,666 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, UNASSIGN 2023-07-18 18:11:38,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, UNASSIGN 2023-07-18 18:11:38,667 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6359261b56d58eb2cdffc8517e6ccb35, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:38,667 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6bc50086d58ee4d3e31c93650b91e68e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:38,667 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703898667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703898667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703898667"}]},"ts":"1689703898667"} 2023-07-18 18:11:38,667 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703898667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703898667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703898667"}]},"ts":"1689703898667"} 2023-07-18 18:11:38,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure 6359261b56d58eb2cdffc8517e6ccb35, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:11:38,670 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 6bc50086d58ee4d3e31c93650b91e68e, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:38,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6359261b56d58eb2cdffc8517e6ccb35, disabling compactions & flushes 2023-07-18 18:11:38,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,824 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. after waiting 0 ms 2023-07-18 18:11:38,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bc50086d58ee4d3e31c93650b91e68e, disabling compactions & flushes 2023-07-18 18:11:38,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6359261b56d58eb2cdffc8517e6ccb35 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 18:11:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. after waiting 0 ms 2023-07-18 18:11:38,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6bc50086d58ee4d3e31c93650b91e68e 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-18 18:11:38,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/.tmp/cf/bfac8b498c70453d8e936c66cdfcf35c 2023-07-18 18:11:38,839 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/.tmp/cf/fbdf780ae70f485fb3169beb50c69487 2023-07-18 18:11:38,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/.tmp/cf/bfac8b498c70453d8e936c66cdfcf35c as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf/bfac8b498c70453d8e936c66cdfcf35c 2023-07-18 18:11:38,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/.tmp/cf/fbdf780ae70f485fb3169beb50c69487 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf/fbdf780ae70f485fb3169beb50c69487 2023-07-18 18:11:38,852 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf/bfac8b498c70453d8e936c66cdfcf35c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 18:11:38,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf/fbdf780ae70f485fb3169beb50c69487, entries=1, sequenceid=5, filesize=4.7 K 2023-07-18 18:11:38,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6bc50086d58ee4d3e31c93650b91e68e in 27ms, sequenceid=5, compaction requested=false 2023-07-18 18:11:38,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 18:11:38,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6359261b56d58eb2cdffc8517e6ccb35 in 29ms, sequenceid=5, compaction requested=false 2023-07-18 18:11:38,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 18:11:38,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-18 18:11:38,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:38,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:38,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e. 2023-07-18 18:11:38,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35. 2023-07-18 18:11:38,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bc50086d58ee4d3e31c93650b91e68e: 2023-07-18 18:11:38,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6359261b56d58eb2cdffc8517e6ccb35: 2023-07-18 18:11:38,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:38,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6bc50086d58ee4d3e31c93650b91e68e, regionState=CLOSED 2023-07-18 18:11:38,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703898870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703898870"}]},"ts":"1689703898870"} 2023-07-18 18:11:38,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:38,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6359261b56d58eb2cdffc8517e6ccb35, regionState=CLOSED 2023-07-18 18:11:38,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689703898870"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703898870"}]},"ts":"1689703898870"} 2023-07-18 18:11:38,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-18 18:11:38,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 6bc50086d58ee4d3e31c93650b91e68e, server=jenkins-hbase4.apache.org,33749,1689703817568 in 201 msec 2023-07-18 18:11:38,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-18 18:11:38,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure 6359261b56d58eb2cdffc8517e6ccb35, server=jenkins-hbase4.apache.org,38743,1689703817702 in 203 msec 2023-07-18 18:11:38,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6bc50086d58ee4d3e31c93650b91e68e, UNASSIGN in 212 msec 2023-07-18 18:11:38,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-18 18:11:38,875 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6359261b56d58eb2cdffc8517e6ccb35, UNASSIGN in 209 msec 2023-07-18 18:11:38,915 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-18 18:11:38,918 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897468.6bc50086d58ee4d3e31c93650b91e68e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:38,918 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689703897468.6359261b56d58eb2cdffc8517e6ccb35.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:38,918 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:38,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:38,976 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, ASSIGN}] 2023-07-18 18:11:38,977 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, ASSIGN 2023-07-18 18:11:38,978 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:11:39,124 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:11:39,128 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-18 18:11:39,137 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ae82f2d89f4e09e82cb402ade51c2df6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,137 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703899137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703899137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703899137"}]},"ts":"1689703899137"} 2023-07-18 18:11:39,140 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure ae82f2d89f4e09e82cb402ade51c2df6, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:39,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:39,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:39,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae82f2d89f4e09e82cb402ade51c2df6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.', STARTKEY => '', ENDKEY => ''} 2023-07-18 18:11:39,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. service=AccessControlService 2023-07-18 18:11:39,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:39,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:39,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/.regioninfo 2023-07-18 18:11:39,328 INFO [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,332 DEBUG [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf 2023-07-18 18:11:39,332 DEBUG [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf 2023-07-18 18:11:39,333 INFO [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae82f2d89f4e09e82cb402ade51c2df6 columnFamilyName cf 2023-07-18 18:11:39,372 DEBUG [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] regionserver.HStore(539): loaded hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/bfac8b498c70453d8e936c66cdfcf35c.6bc50086d58ee4d3e31c93650b91e68e->hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf/bfac8b498c70453d8e936c66cdfcf35c-top 2023-07-18 18:11:39,379 DEBUG [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] regionserver.HStore(539): loaded hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/fbdf780ae70f485fb3169beb50c69487.6359261b56d58eb2cdffc8517e6ccb35->hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf/fbdf780ae70f485fb3169beb50c69487-top 2023-07-18 18:11:39,380 INFO [StoreOpener-ae82f2d89f4e09e82cb402ade51c2df6-1] regionserver.HStore(310): Store=ae82f2d89f4e09e82cb402ade51c2df6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:39,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:39,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ae82f2d89f4e09e82cb402ade51c2df6; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73197358, jitterRate=0.09072563052177429}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:39,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ae82f2d89f4e09e82cb402ade51c2df6: 2023-07-18 18:11:39,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6., pid=77, masterSystemTime=1689703899294 2023-07-18 18:11:39,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.,because compaction is disabled. 2023-07-18 18:11:39,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:39,407 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:39,407 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=ae82f2d89f4e09e82cb402ade51c2df6, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,408 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703899407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703899407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703899407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703899407"}]},"ts":"1689703899407"} 2023-07-18 18:11:39,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-18 18:11:39,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure ae82f2d89f4e09e82cb402ade51c2df6, server=jenkins-hbase4.apache.org,33749,1689703817568 in 269 msec 2023-07-18 18:11:39,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-18 18:11:39,414 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, ASSIGN in 436 msec 2023-07-18 18:11:39,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6bc50086d58ee4d3e31c93650b91e68e, 6359261b56d58eb2cdffc8517e6ccb35], force=true in 785 msec 2023-07-18 18:11:39,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-18 18:11:39,745 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-18 18:11:39,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 18:11:39,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703899746 (current time:1689703899746). 2023-07-18 18:11:39,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:39,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x55634ea7 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:39,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54921169, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:39,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:39,764 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:39,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55634ea7 to 127.0.0.1:55531 2023-07-18 18:11:39,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:39,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x2902bd88 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:39,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66dbd879, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:39,784 DEBUG [hconnection-0x22868492-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:39,785 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:39,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2902bd88 to 127.0.0.1:55531 2023-07-18 18:11:39,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:39,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-18 18:11:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 18:11:39,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 18:11:39,794 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 18:11:39,795 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689704499795 2023-07-18 18:11:39,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-18 18:11:39,798 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:39,799 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:39,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 18:11:39,800 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-18 18:11:39,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-18 18:11:39,801 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 18:11:39,802 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689704499802 2023-07-18 18:11:39,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,817 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-18 18:11:39,817 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,819 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-18 18:11:39,819 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-18 18:11:39,824 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,824 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,826 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,826 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,826 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,826 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,827 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,827 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:39,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,828 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 18:11:39,829 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-18 18:11:39,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 18:11:39,831 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,846 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 18:11:39,846 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 18:11:39,846 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 18:11:39,849 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,849 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,850 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:39,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 18:11:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-18 18:11:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,851 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:39,852 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 18:11:39,852 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-18 18:11:39,852 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 18:11:39,852 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-18 18:11:39,852 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 18:11:39,852 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-18 18:11:39,854 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:39,854 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,855 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:39,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,856 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-18 18:11:39,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a05b148[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:39,857 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-18 18:11:39,857 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 18:11:39,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 18:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:39,858 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 18:11:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-18 18:11:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 18:11:39,859 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 18:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,860 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 18:11:39,858 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,862 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 18:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 18:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:39,862 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:39,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:39,870 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. started... 2023-07-18 18:11:39,872 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ae82f2d89f4e09e82cb402ade51c2df6: 2023-07-18 18:11:39,872 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,872 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:39,872 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/bfac8b498c70453d8e936c66cdfcf35c.6bc50086d58ee4d3e31c93650b91e68e->hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf/bfac8b498c70453d8e936c66cdfcf35c-top, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/fbdf780ae70f485fb3169beb50c69487.6359261b56d58eb2cdffc8517e6ccb35->hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf/fbdf780ae70f485fb3169beb50c69487-top] hfiles 2023-07-18 18:11:39,872 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/bfac8b498c70453d8e936c66cdfcf35c.6bc50086d58ee4d3e31c93650b91e68e for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,873 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/fbdf780ae70f485fb3169beb50c69487.6359261b56d58eb2cdffc8517e6ccb35 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,899 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:39,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:39,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:39,900 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:39,923 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. completed. 2023-07-18 18:11:39,923 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:39,923 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:39,923 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:39,923 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,923 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-18 18:11:39,923 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:39,930 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-18 18:11:39,930 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,930 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,930 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-18 18:11:39,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:11:39,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-18 18:11:39,937 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-18 18:11:39,937 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:39,938 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:39,938 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,938 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:39,939 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,939 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,939 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:39,940 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,939 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:39,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,940 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,941 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,942 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,942 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:39,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:39,945 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,945 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,946 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,949 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,949 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:39,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,950 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,950 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:39,953 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:39,953 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:39,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:39,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:39,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:39,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:40,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:40,101 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:40,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:40,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:40,102 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:40,114 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-18 18:11:40,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:40,115 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:40,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689703899795Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703899950 (+155 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703899950Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703899970 (+20 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689703900029 (+59 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689703900114 (+85 ms) 2023-07-18 18:11:40,118 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-18 18:11:40,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 320 msec 2023-07-18 18:11:40,402 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:40,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-18 18:11:40,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:40,404 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404 2023-07-18 18:11:40,404 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43971, tgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404, rawTgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:40,427 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:40,428 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_229289748_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:40,428 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-18 18:11:40,437 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:40,462 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,463 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,463 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,463 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,464 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,464 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,464 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,543 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-1841984314156596559.jar 2023-07-18 18:11:40,544 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,545 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,545 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,545 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,546 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,546 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:40,547 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:40,547 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:40,548 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:40,549 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:40,549 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:40,550 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:40,550 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:40,551 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:40,551 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:40,552 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:40,552 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:40,553 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:40,553 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:40,554 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:40,554 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:40,554 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:40,555 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:41,563 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:11:41,568 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-18 18:11:41,570 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-18 18:11:41,709 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:41,710 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:11:41,723 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:44,370 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:11:47,312 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:49,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:53,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0005_000001 (auth:SIMPLE) 2023-07-18 18:11:55,889 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:11:55,893 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:11:55,915 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:55,915 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:11:55,919 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:11:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 18:11:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 18:11:55,919 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:55,920 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-18 18:11:55,920 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703900404/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-18 18:11:55,944 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:55,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:55,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:55,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:11:55,950 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703915950"}]},"ts":"1689703915950"} 2023-07-18 18:11:55,952 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-18 18:11:55,954 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-18 18:11:55,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, UNASSIGN}] 2023-07-18 18:11:55,958 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, UNASSIGN 2023-07-18 18:11:55,958 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ae82f2d89f4e09e82cb402ade51c2df6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:55,958 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703915958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703915958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703915958"}]},"ts":"1689703915958"} 2023-07-18 18:11:55,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure ae82f2d89f4e09e82cb402ade51c2df6, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:56,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:11:56,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ae82f2d89f4e09e82cb402ade51c2df6, disabling compactions & flushes 2023-07-18 18:11:56,114 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. after waiting 0 ms 2023-07-18 18:11:56,114 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:56,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-18 18:11:56,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:56,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6. 2023-07-18 18:11:56,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ae82f2d89f4e09e82cb402ade51c2df6: 2023-07-18 18:11:56,140 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=ae82f2d89f4e09e82cb402ade51c2df6, regionState=CLOSED 2023-07-18 18:11:56,140 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689703916140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703916140"}]},"ts":"1689703916140"} 2023-07-18 18:11:56,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:56,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-18 18:11:56,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure ae82f2d89f4e09e82cb402ade51c2df6, server=jenkins-hbase4.apache.org,33749,1689703817568 in 181 msec 2023-07-18 18:11:56,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-18 18:11:56,150 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=ae82f2d89f4e09e82cb402ade51c2df6, UNASSIGN in 193 msec 2023-07-18 18:11:56,152 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703916152"}]},"ts":"1689703916152"} 2023-07-18 18:11:56,153 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-18 18:11:56,156 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-18 18:11:56,159 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 212 msec 2023-07-18 18:11:56,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-18 18:11:56,258 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-18 18:11:56,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,263 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,264 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,267 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,270 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,270 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,270 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,270 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:11:56,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:11:56,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:11:56,272 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-18 18:11:56,277 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,277 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,277 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,277 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,278 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,278 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,278 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,278 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 18:11:56,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:56,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:56,279 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:56,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:56,290 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:56,290 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:56,300 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:56,300 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/recovered.edits] 2023-07-18 18:11:56,301 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/recovered.edits] 2023-07-18 18:11:56,303 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/recovered.edits] 2023-07-18 18:11:56,311 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf/fbdf780ae70f485fb3169beb50c69487 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/cf/fbdf780ae70f485fb3169beb50c69487 2023-07-18 18:11:56,313 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/bfac8b498c70453d8e936c66cdfcf35c.6bc50086d58ee4d3e31c93650b91e68e to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/bfac8b498c70453d8e936c66cdfcf35c.6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:56,318 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/fbdf780ae70f485fb3169beb50c69487.6359261b56d58eb2cdffc8517e6ccb35 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/cf/fbdf780ae70f485fb3169beb50c69487.6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:56,318 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/recovered.edits/8.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35/recovered.edits/8.seqid 2023-07-18 18:11:56,319 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6359261b56d58eb2cdffc8517e6ccb35 2023-07-18 18:11:56,320 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf/bfac8b498c70453d8e936c66cdfcf35c to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/cf/bfac8b498c70453d8e936c66cdfcf35c 2023-07-18 18:11:56,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/recovered.edits/12.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6/recovered.edits/12.seqid 2023-07-18 18:11:56,324 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/ae82f2d89f4e09e82cb402ade51c2df6 2023-07-18 18:11:56,324 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/recovered.edits/8.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e/recovered.edits/8.seqid 2023-07-18 18:11:56,325 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6bc50086d58ee4d3e31c93650b91e68e 2023-07-18 18:11:56,325 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-18 18:11:56,328 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,337 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-18 18:11:56,354 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-18 18:11:56,356 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,357 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-18 18:11:56,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703916357"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:56,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 18:11:56,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-18 18:11:56,392 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ae82f2d89f4e09e82cb402ade51c2df6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689703897469.ae82f2d89f4e09e82cb402ade51c2df6.', STARTKEY => '', ENDKEY => ''}] 2023-07-18 18:11:56,393 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-18 18:11:56,393 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703916393"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:56,409 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-18 18:11:56,413 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:56,414 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 154 msec 2023-07-18 18:11:56,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-18 18:11:56,583 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-18 18:11:56,584 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,597 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703916597"}]},"ts":"1689703916597"} 2023-07-18 18:11:56,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:11:56,598 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-18 18:11:56,601 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-18 18:11:56,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, UNASSIGN}] 2023-07-18 18:11:56,607 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, UNASSIGN 2023-07-18 18:11:56,607 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, UNASSIGN 2023-07-18 18:11:56,608 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1069b7aed824acc44267f2c7cf2313ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:56,608 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703916608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703916608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703916608"}]},"ts":"1689703916608"} 2023-07-18 18:11:56,608 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=58a898948602532090f9e65556a5c9d6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:56,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703916608"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703916608"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703916608"}]},"ts":"1689703916608"} 2023-07-18 18:11:56,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 1069b7aed824acc44267f2c7cf2313ef, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:11:56,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 58a898948602532090f9e65556a5c9d6, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:11:56,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:11:56,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:56,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 58a898948602532090f9e65556a5c9d6, disabling compactions & flushes 2023-07-18 18:11:56,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:56,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:56,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. after waiting 0 ms 2023-07-18 18:11:56,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:56,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:56,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1069b7aed824acc44267f2c7cf2313ef, disabling compactions & flushes 2023-07-18 18:11:56,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:56,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:56,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. after waiting 0 ms 2023-07-18 18:11:56,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:56,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:56,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:56,832 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6. 2023-07-18 18:11:56,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 58a898948602532090f9e65556a5c9d6: 2023-07-18 18:11:56,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:11:56,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:11:56,835 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef. 2023-07-18 18:11:56,835 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1069b7aed824acc44267f2c7cf2313ef: 2023-07-18 18:11:56,837 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:56,837 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=58a898948602532090f9e65556a5c9d6, regionState=CLOSED 2023-07-18 18:11:56,837 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703916837"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703916837"}]},"ts":"1689703916837"} 2023-07-18 18:11:56,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:56,839 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=1069b7aed824acc44267f2c7cf2313ef, regionState=CLOSED 2023-07-18 18:11:56,839 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689703916839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703916839"}]},"ts":"1689703916839"} 2023-07-18 18:11:56,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-18 18:11:56,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 58a898948602532090f9e65556a5c9d6, server=jenkins-hbase4.apache.org,39363,1689703817431 in 217 msec 2023-07-18 18:11:56,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-18 18:11:56,842 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=58a898948602532090f9e65556a5c9d6, UNASSIGN in 238 msec 2023-07-18 18:11:56,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 1069b7aed824acc44267f2c7cf2313ef, server=jenkins-hbase4.apache.org,38743,1689703817702 in 229 msec 2023-07-18 18:11:56,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-18 18:11:56,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=1069b7aed824acc44267f2c7cf2313ef, UNASSIGN in 239 msec 2023-07-18 18:11:56,844 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703916844"}]},"ts":"1689703916844"} 2023-07-18 18:11:56,845 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-18 18:11:56,847 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-18 18:11:56,852 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 262 msec 2023-07-18 18:11:56,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-18 18:11:56,901 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-18 18:11:56,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,907 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,908 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,909 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,914 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,915 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,915 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:11:56,915 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:11:56,916 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:11:56,916 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:56,916 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:56,916 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-18 18:11:56,917 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,918 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,918 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,918 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,918 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,918 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,918 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,919 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:56,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 18:11:56,920 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/recovered.edits] 2023-07-18 18:11:56,920 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/recovered.edits] 2023-07-18 18:11:56,925 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf/165fc2ee917243fb8429612154a2170d to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/cf/165fc2ee917243fb8429612154a2170d 2023-07-18 18:11:56,926 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf/661586203276459cb1052908c5486bf3 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/cf/661586203276459cb1052908c5486bf3 2023-07-18 18:11:56,930 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6/recovered.edits/9.seqid 2023-07-18 18:11:56,930 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/58a898948602532090f9e65556a5c9d6 2023-07-18 18:11:56,931 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef/recovered.edits/9.seqid 2023-07-18 18:11:56,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/1069b7aed824acc44267f2c7cf2313ef 2023-07-18 18:11:56,932 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-18 18:11:56,934 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,938 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-18 18:11:56,941 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-18 18:11:56,943 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,943 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-18 18:11:56,943 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703916943"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:56,943 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703916943"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:56,947 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:11:56,947 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1069b7aed824acc44267f2c7cf2313ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689703894273.1069b7aed824acc44267f2c7cf2313ef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 58a898948602532090f9e65556a5c9d6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689703894273.58a898948602532090f9e65556a5c9d6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:11:56,947 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-18 18:11:56,948 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703916947"}]},"ts":"9223372036854775807"} 2023-07-18 18:11:56,955 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-18 18:11:56,959 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:56,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 57 msec 2023-07-18 18:11:57,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-18 18:11:57,021 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-18 18:11:57,041 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 18:11:57,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:57,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-18 18:11:57,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-18 18:11:57,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-18 18:11:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-18 18:11:57,096 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=760 (was 745) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:35549 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2064411266_1 at /127.0.0.1:39500 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3941 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:55222 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:39512 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:44220 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=588 (was 476) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 190), AvailableMemoryMB=2022 (was 2681) 2023-07-18 18:11:57,097 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-18 18:11:57,139 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=760, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=588, ProcessCount=190, AvailableMemoryMB=2008 2023-07-18 18:11:57,139 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-18 18:11:57,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:11:57,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:11:57,145 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:11:57,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-18 18:11:57,146 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:11:57,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:11:57,150 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,150 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,151 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 empty. 2023-07-18 18:11:57,151 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 empty. 2023-07-18 18:11:57,152 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,152 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,152 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 18:11:57,193 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-18 18:11:57,195 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 50480aab681b9a6e74ab6e553d8da459, NAME => 'testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:57,195 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 33fe543059e1df7682e19dab1439f108, NAME => 'testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:11:57,211 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:57,211 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 50480aab681b9a6e74ab6e553d8da459, disabling compactions & flushes 2023-07-18 18:11:57,211 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,211 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,211 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. after waiting 0 ms 2023-07-18 18:11:57,211 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,211 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,212 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 50480aab681b9a6e74ab6e553d8da459: 2023-07-18 18:11:57,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:57,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 33fe543059e1df7682e19dab1439f108, disabling compactions & flushes 2023-07-18 18:11:57,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. after waiting 0 ms 2023-07-18 18:11:57,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,219 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,219 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 33fe543059e1df7682e19dab1439f108: 2023-07-18 18:11:57,222 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:11:57,223 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703917222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703917222"}]},"ts":"1689703917222"} 2023-07-18 18:11:57,223 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703917222"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703917222"}]},"ts":"1689703917222"} 2023-07-18 18:11:57,225 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:11:57,225 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:11:57,226 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703917226"}]},"ts":"1689703917226"} 2023-07-18 18:11:57,227 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-18 18:11:57,231 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:11:57,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:11:57,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:11:57,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:11:57,232 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:11:57,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, ASSIGN}] 2023-07-18 18:11:57,241 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, ASSIGN 2023-07-18 18:11:57,241 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, ASSIGN 2023-07-18 18:11:57,242 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:11:57,242 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39363,1689703817431; forceNewPlan=false, retain=false 2023-07-18 18:11:57,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:11:57,392 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:11:57,396 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=50480aab681b9a6e74ab6e553d8da459, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,396 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=33fe543059e1df7682e19dab1439f108, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,396 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703917396"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703917396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703917396"}]},"ts":"1689703917396"} 2023-07-18 18:11:57,396 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703917396"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703917396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703917396"}]},"ts":"1689703917396"} 2023-07-18 18:11:57,400 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 33fe543059e1df7682e19dab1439f108, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:11:57,400 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 50480aab681b9a6e74ab6e553d8da459, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:11:57,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:11:57,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50480aab681b9a6e74ab6e553d8da459, NAME => 'testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:11:57,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. service=AccessControlService 2023-07-18 18:11:57,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 33fe543059e1df7682e19dab1439f108, NAME => 'testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. service=AccessControlService 2023-07-18 18:11:57,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,561 INFO [StoreOpener-50480aab681b9a6e74ab6e553d8da459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,562 INFO [StoreOpener-33fe543059e1df7682e19dab1439f108-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,564 DEBUG [StoreOpener-50480aab681b9a6e74ab6e553d8da459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf 2023-07-18 18:11:57,564 DEBUG [StoreOpener-50480aab681b9a6e74ab6e553d8da459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf 2023-07-18 18:11:57,565 INFO [StoreOpener-50480aab681b9a6e74ab6e553d8da459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50480aab681b9a6e74ab6e553d8da459 columnFamilyName cf 2023-07-18 18:11:57,565 INFO [StoreOpener-50480aab681b9a6e74ab6e553d8da459-1] regionserver.HStore(310): Store=50480aab681b9a6e74ab6e553d8da459/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:57,566 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,568 DEBUG [StoreOpener-33fe543059e1df7682e19dab1439f108-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf 2023-07-18 18:11:57,568 DEBUG [StoreOpener-33fe543059e1df7682e19dab1439f108-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf 2023-07-18 18:11:57,568 INFO [StoreOpener-33fe543059e1df7682e19dab1439f108-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 33fe543059e1df7682e19dab1439f108 columnFamilyName cf 2023-07-18 18:11:57,569 INFO [StoreOpener-33fe543059e1df7682e19dab1439f108-1] regionserver.HStore(310): Store=33fe543059e1df7682e19dab1439f108/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:11:57,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:11:57,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,577 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 33fe543059e1df7682e19dab1439f108 2023-07-18 18:11:57,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:57,596 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 50480aab681b9a6e74ab6e553d8da459; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65541045, jitterRate=-0.02336232364177704}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:57,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 50480aab681b9a6e74ab6e553d8da459: 2023-07-18 18:11:57,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:11:57,598 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459., pid=94, masterSystemTime=1689703917555 2023-07-18 18:11:57,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 33fe543059e1df7682e19dab1439f108; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74069286, jitterRate=0.10371837019920349}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:11:57,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 33fe543059e1df7682e19dab1439f108: 2023-07-18 18:11:57,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108., pid=93, masterSystemTime=1689703917554 2023-07-18 18:11:57,601 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=50480aab681b9a6e74ab6e553d8da459, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,601 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703917601"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703917601"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703917601"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703917601"}]},"ts":"1689703917601"} 2023-07-18 18:11:57,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,603 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=33fe543059e1df7682e19dab1439f108, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,603 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703917603"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703917603"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703917603"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703917603"}]},"ts":"1689703917603"} 2023-07-18 18:11:57,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-18 18:11:57,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 50480aab681b9a6e74ab6e553d8da459, server=jenkins-hbase4.apache.org,39363,1689703817431 in 203 msec 2023-07-18 18:11:57,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-18 18:11:57,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 33fe543059e1df7682e19dab1439f108, server=jenkins-hbase4.apache.org,33749,1689703817568 in 205 msec 2023-07-18 18:11:57,611 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, ASSIGN in 374 msec 2023-07-18 18:11:57,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-18 18:11:57,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, ASSIGN in 374 msec 2023-07-18 18:11:57,636 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:11:57,637 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703917636"}]},"ts":"1689703917636"} 2023-07-18 18:11:57,638 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-18 18:11:57,641 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:11:57,641 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-18 18:11:57,643 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:11:57,644 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:57,644 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:57,644 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:57,645 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:11:57,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:57,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:57,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:57,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-18 18:11:57,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 508 msec 2023-07-18 18:11:57,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-18 18:11:57,753 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-18 18:11:57,754 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-18 18:11:57,754 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:57,759 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-18 18:11:57,759 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:57,759 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-18 18:11:57,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:11:57,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703917762 (current time:1689703917762). 2023-07-18 18:11:57,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:57,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x00e6c65b to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:57,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@650b92ce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:57,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:57,810 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:57,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00e6c65b to 127.0.0.1:55531 2023-07-18 18:11:57,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:57,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x4bde048e to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:57,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d3cc7b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:57,825 DEBUG [hconnection-0x4498b73b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:57,828 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:57,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4bde048e to 127.0.0.1:55531 2023-07-18 18:11:57,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:57,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:11:57,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:57,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:11:57,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:11:57,843 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:11:57,843 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704517843 2023-07-18 18:11:57,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:11:57,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 18:11:57,846 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:57,846 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:57,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:11:57,849 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:11:57,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 9 msec 2023-07-18 18:11:57,856 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:11:57,859 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704517859 2023-07-18 18:11:57,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,871 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-18 18:11:57,872 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:57,873 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 18:11:57,873 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:11:57,874 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,874 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,877 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:57,877 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:57,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:57,878 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,878 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:57,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:57,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,878 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,879 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,879 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,879 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:11:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,880 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:11:57,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:11:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:57,881 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:11:57,882 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:11:57,882 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:57,882 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:57,886 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:11:57,886 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:11:57,886 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:11:57,886 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:11:57,886 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:11:57,886 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:11:57,887 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:11:57,890 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,890 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:57,890 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,891 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,891 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,892 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,892 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:57,892 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,892 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:57,892 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,892 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:57,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436d78a1[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:57,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:57,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:11:57,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@436d78a1[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:57,897 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:11:57,897 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,899 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,899 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,899 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,899 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:57,902 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:11:57,903 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,903 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,903 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:11:57,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,903 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:11:57,903 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:11:57,903 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:11:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:57,905 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:11:57,906 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:57,931 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:57,924 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,923 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,932 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. started... 2023-07-18 18:11:57,923 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:57,932 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:57,932 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. started... 2023-07-18 18:11:57,934 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50480aab681b9a6e74ab6e553d8da459: 2023-07-18 18:11:57,935 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33fe543059e1df7682e19dab1439f108: 2023-07-18 18:11:57,935 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,935 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,935 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:57,935 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:57,935 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:57,936 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:11:57,946 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:57,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:11:57,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:57,948 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:57,957 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. completed. 2023-07-18 18:11:57,957 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:57,957 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:57,957 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:57,957 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,963 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:11:57,963 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:57,964 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:11:57,964 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:57,964 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:11:57,964 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:57,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:57,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,969 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. completed. 2023-07-18 18:11:57,969 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:57,969 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:57,969 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:57,969 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,970 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:11:57,970 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:57,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,972 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:11:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:57,973 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:57,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:57,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:57,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:11:57,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:11:57,981 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 18:11:57,981 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:57,981 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:57,981 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,981 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:57,983 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,983 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:57,984 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,983 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:57,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:57,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:57,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:57,984 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,985 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:57,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,987 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,987 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:57,988 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,991 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:57,991 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:57,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:57,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:57,991 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:57,992 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:57,992 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:57,992 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,992 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:57,992 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,992 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:57,993 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,994 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:57,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:57,994 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,994 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:57,994 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:57,994 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,994 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,994 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,995 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,995 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:57,995 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:57,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-18 18:11:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:57,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,044 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 18:11:58,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,044 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689703917844Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689703917993 (+149 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689703917994 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689703917998 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689703918015 (+17 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689703918044 (+29 ms) 2023-07-18 18:11:58,049 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:11:58,050 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 204 msec 2023-07-18 18:11:58,148 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:58,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:11:58,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:58,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39363] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:58,158 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33749] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:11:58,161 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-18 18:11:58,161 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:58,161 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:11:58,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:11:58,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703918178 (current time:1689703918178). 2023-07-18 18:11:58,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:11:58,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x487ce070 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:58,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49dca72b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:58,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:58,189 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x487ce070 to 127.0.0.1:55531 2023-07-18 18:11:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x7e350017 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:11:58,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51e510c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:11:58,198 DEBUG [hconnection-0x7d2c1029-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:11:58,201 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:11:58,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e350017 to 127.0.0.1:55531 2023-07-18 18:11:58,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:11:58,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-18 18:11:58,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:11:58,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:11:58,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:11:58,210 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:11:58,211 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689704518211 2023-07-18 18:11:58,211 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-18 18:11:58,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-18 18:11:58,213 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:11:58,213 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:11:58,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:11:58,218 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-18 18:11:58,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-18 18:11:58,220 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:11:58,220 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689704518220 2023-07-18 18:11:58,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,229 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-18 18:11:58,229 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:58,230 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-18 18:11:58,231 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-18 18:11:58,311 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,311 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,312 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:58,312 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:58,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:58,312 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,312 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:58,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,313 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,313 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,313 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,313 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,314 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,314 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:11:58,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,314 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:11:58,314 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:11:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-18 18:11:58,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,315 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-18 18:11:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:11:58,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:11:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:58,315 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,315 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-18 18:11:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:11:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:11:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:11:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:11:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-18 18:11:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:11:58,317 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-18 18:11:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:11:58,322 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:11:58,321 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-18 18:11:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,323 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:58,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:58,323 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,324 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,328 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:11:58,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:58,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:11:58,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60780120[Count = 1] remaining members to acquire global barrier 2023-07-18 18:11:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:58,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:58,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-18 18:11:58,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60780120[Count = 0] remaining members to acquire global barrier 2023-07-18 18:11:58,333 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-18 18:11:58,333 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:11:58,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-18 18:11:58,339 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,339 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:58,339 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:11:58,339 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:58,339 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. started... 2023-07-18 18:11:58,339 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:11:58,340 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. started... 2023-07-18 18:11:58,340 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50480aab681b9a6e74ab6e553d8da459 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-18 18:11:58,340 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 33fe543059e1df7682e19dab1439f108 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-18 18:11:58,341 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:11:58,341 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:58,341 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:11:58,367 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/.tmp/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37 2023-07-18 18:11:58,385 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/.tmp/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37 2023-07-18 18:11:58,395 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37, entries=2, sequenceid=6, filesize=5.0 K 2023-07-18 18:11:58,396 INFO [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 50480aab681b9a6e74ab6e553d8da459 in 56ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:58,396 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-18 18:11:58,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50480aab681b9a6e74ab6e553d8da459: 2023-07-18 18:11:58,397 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,399 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:58,399 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37] hfiles 2023-07-18 18:11:58,399 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,436 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. completed. 2023-07-18 18:11:58,436 DEBUG [rs(jenkins-hbase4.apache.org,39363,1689703817431)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:11:58,436 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:58,436 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:58,436 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,436 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:11:58,436 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:11:58,438 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,438 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:11:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:58,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:58,438 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:58,438 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:11:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:58,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39363,1689703817431': 2023-07-18 18:11:58,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-18 18:11:58,515 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:58,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:11:58,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:58,516 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:11:58,772 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/.tmp/cf/744e411016ba4f97a41cfba3cb191eff 2023-07-18 18:11:58,778 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/.tmp/cf/744e411016ba4f97a41cfba3cb191eff as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf/744e411016ba4f97a41cfba3cb191eff 2023-07-18 18:11:58,783 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf/744e411016ba4f97a41cfba3cb191eff, entries=48, sequenceid=6, filesize=8.1 K 2023-07-18 18:11:58,784 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 33fe543059e1df7682e19dab1439f108 in 444ms, sequenceid=6, compaction requested=false 2023-07-18 18:11:58,786 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 33fe543059e1df7682e19dab1439f108: 2023-07-18 18:11:58,786 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,786 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:11:58,786 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf/744e411016ba4f97a41cfba3cb191eff] hfiles 2023-07-18 18:11:58,786 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf/744e411016ba4f97a41cfba3cb191eff for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,794 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. completed. 2023-07-18 18:11:58,794 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:11:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:11:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:11:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-18 18:11:58,794 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:11:58,796 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-18 18:11:58,796 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,796 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:58,796 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-18 18:11:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:58,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:58,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:58,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:11:58,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-18 18:11:58,803 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-18 18:11:58,804 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:11:58,804 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:11:58,804 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,804 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:11:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:11:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:58,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,806 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:11:58,807 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,807 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:58,807 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:11:58,809 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,810 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,811 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:58,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:58,814 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:11:58,815 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:58,814 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,814 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,816 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,813 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:11:58,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:58,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,816 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:58,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:58,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:58,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:58,817 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:58,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:11:58,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:11:58,818 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-18 18:11:58,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:11:58,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:11:58,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:11:58,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:11:58,837 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-18 18:11:58,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,855 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:58,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689703918211Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689703918816 (+605 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689703918816Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689703918821 (+5 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689703918830 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689703918854 (+24 ms) 2023-07-18 18:11:58,862 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-18 18:11:58,863 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 650 msec 2023-07-18 18:11:59,318 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:11:59,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-18 18:11:59,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:11:59,319 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319 2023-07-18 18:11:59,320 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43971, tgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319, rawTgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:59,342 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:11:59,342 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-644144704_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:59,342 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-18 18:11:59,348 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:11:59,384 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,385 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,386 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,386 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,387 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,387 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,388 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,463 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-1327444331247521823.jar 2023-07-18 18:11:59,464 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,464 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,464 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,465 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,465 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,465 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:11:59,466 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:11:59,466 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:11:59,466 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:11:59,467 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:11:59,467 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:11:59,467 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:11:59,468 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:11:59,468 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:11:59,468 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:11:59,469 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:11:59,469 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:59,469 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:59,470 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:59,470 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:59,470 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:11:59,471 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:11:59,471 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:00,100 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0005_000001 (auth:SIMPLE) 2023-07-18 18:12:00,230 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:12:00,233 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-18 18:12:00,334 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:00,334 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:00,751 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0006_000001 (auth:SIMPLE) 2023-07-18 18:12:01,763 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:12:06,650 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0006_000001 (auth:SIMPLE) 2023-07-18 18:12:09,673 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:12:09,675 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:12:09,724 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:09,724 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:12:09,725 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:12:09,726 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:09,726 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 18:12:09,726 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 18:12:09,727 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:09,727 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-18 18:12:09,727 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703919319/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-18 18:12:09,746 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-18 18:12:09,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-18 18:12:09,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:09,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 18:12:09,752 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703929752"}]},"ts":"1689703929752"} 2023-07-18 18:12:09,755 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-18 18:12:09,757 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-18 18:12:09,759 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, UNASSIGN}] 2023-07-18 18:12:09,762 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, UNASSIGN 2023-07-18 18:12:09,762 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, UNASSIGN 2023-07-18 18:12:09,763 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=50480aab681b9a6e74ab6e553d8da459, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:09,763 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=33fe543059e1df7682e19dab1439f108, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:09,763 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703929763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703929763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703929763"}]},"ts":"1689703929763"} 2023-07-18 18:12:09,764 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703929763"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703929763"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703929763"}]},"ts":"1689703929763"} 2023-07-18 18:12:09,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 50480aab681b9a6e74ab6e553d8da459, server=jenkins-hbase4.apache.org,39363,1689703817431}] 2023-07-18 18:12:09,768 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 33fe543059e1df7682e19dab1439f108, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:12:09,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 18:12:09,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:12:09,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 50480aab681b9a6e74ab6e553d8da459, disabling compactions & flushes 2023-07-18 18:12:09,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:12:09,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:12:09,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. after waiting 0 ms 2023-07-18 18:12:09,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:12:09,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 33fe543059e1df7682e19dab1439f108 2023-07-18 18:12:09,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 33fe543059e1df7682e19dab1439f108, disabling compactions & flushes 2023-07-18 18:12:09,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:12:09,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:12:09,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. after waiting 0 ms 2023-07-18 18:12:09,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:12:09,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:09,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:09,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459. 2023-07-18 18:12:09,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 50480aab681b9a6e74ab6e553d8da459: 2023-07-18 18:12:09,964 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:09,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:09,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:12:09,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108. 2023-07-18 18:12:09,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 33fe543059e1df7682e19dab1439f108: 2023-07-18 18:12:09,967 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=50480aab681b9a6e74ab6e553d8da459, regionState=CLOSED 2023-07-18 18:12:09,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703929967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703929967"}]},"ts":"1689703929967"} 2023-07-18 18:12:09,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 33fe543059e1df7682e19dab1439f108 2023-07-18 18:12:09,970 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=33fe543059e1df7682e19dab1439f108, regionState=CLOSED 2023-07-18 18:12:09,970 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689703929970"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703929970"}]},"ts":"1689703929970"} 2023-07-18 18:12:09,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-18 18:12:09,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 50480aab681b9a6e74ab6e553d8da459, server=jenkins-hbase4.apache.org,39363,1689703817431 in 203 msec 2023-07-18 18:12:09,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=50480aab681b9a6e74ab6e553d8da459, UNASSIGN in 212 msec 2023-07-18 18:12:09,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-18 18:12:09,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 33fe543059e1df7682e19dab1439f108, server=jenkins-hbase4.apache.org,33749,1689703817568 in 205 msec 2023-07-18 18:12:09,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-18 18:12:09,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=33fe543059e1df7682e19dab1439f108, UNASSIGN in 214 msec 2023-07-18 18:12:09,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703929976"}]},"ts":"1689703929976"} 2023-07-18 18:12:09,977 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-18 18:12:09,979 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-18 18:12:09,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 233 msec 2023-07-18 18:12:10,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-18 18:12:10,057 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-18 18:12:10,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,062 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,063 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,065 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 2023-07-18 18:12:10,069 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:12:10,070 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,070 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,070 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,070 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:10,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:10,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:10,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-18 18:12:10,072 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/recovered.edits] 2023-07-18 18:12:10,072 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,072 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,072 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,073 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,073 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,072 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,073 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,073 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 18:12:10,074 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/recovered.edits] 2023-07-18 18:12:10,079 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf/744e411016ba4f97a41cfba3cb191eff to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/cf/744e411016ba4f97a41cfba3cb191eff 2023-07-18 18:12:10,084 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/cf/11d7b93e54fc4f5aa0a1b1b28ed5cd37 2023-07-18 18:12:10,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108/recovered.edits/9.seqid 2023-07-18 18:12:10,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/33fe543059e1df7682e19dab1439f108 2023-07-18 18:12:10,091 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459/recovered.edits/9.seqid 2023-07-18 18:12:10,092 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testEmptyExportFileSystemState/50480aab681b9a6e74ab6e553d8da459 2023-07-18 18:12:10,092 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-18 18:12:10,095 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,105 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-18 18:12:10,122 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-18 18:12:10,124 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,124 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-18 18:12:10,124 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703930124"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:10,124 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703930124"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:10,127 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:12:10,127 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 50480aab681b9a6e74ab6e553d8da459, NAME => 'testtb-testEmptyExportFileSystemState,,1689703917141.50480aab681b9a6e74ab6e553d8da459.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 33fe543059e1df7682e19dab1439f108, NAME => 'testtb-testEmptyExportFileSystemState,1,1689703917141.33fe543059e1df7682e19dab1439f108.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:12:10,127 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-18 18:12:10,127 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703930127"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:10,129 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-18 18:12:10,131 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-18 18:12:10,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 73 msec 2023-07-18 18:12:10,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-18 18:12:10,176 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-18 18:12:10,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-18 18:12:10,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:10,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-18 18:12:10,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-18 18:12:10,223 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 760) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:45523 from appattempt_1689703825606_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:56180 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:46028 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:44944 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4594 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:38115 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_472885239_1 at /127.0.0.1:56152 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=572 (was 588), ProcessCount=187 (was 190), AvailableMemoryMB=1356 (was 2008) 2023-07-18 18:12:10,223 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-18 18:12:10,252 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=572, ProcessCount=187, AvailableMemoryMB=1355 2023-07-18 18:12:10,252 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-18 18:12:10,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-18 18:12:10,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:10,258 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-18 18:12:10,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-18 18:12:10,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:10,259 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-18 18:12:10,262 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,262 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,263 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 empty. 2023-07-18 18:12:10,263 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 empty. 2023-07-18 18:12:10,263 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,263 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,263 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 18:12:10,297 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-18 18:12:10,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 140720173fe28a76d69330d35a1b1b19, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:12:10,298 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 029e2679c74afa78798df3b423ab3838, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp 2023-07-18 18:12:10,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:10,424 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:10,424 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 029e2679c74afa78798df3b423ab3838, disabling compactions & flushes 2023-07-18 18:12:10,424 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,424 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,424 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. after waiting 0 ms 2023-07-18 18:12:10,424 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,424 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,424 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 029e2679c74afa78798df3b423ab3838: 2023-07-18 18:12:10,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:10,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 140720173fe28a76d69330d35a1b1b19, disabling compactions & flushes 2023-07-18 18:12:10,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. after waiting 0 ms 2023-07-18 18:12:10,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 140720173fe28a76d69330d35a1b1b19: 2023-07-18 18:12:10,448 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-18 18:12:10,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703930450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703930450"}]},"ts":"1689703930450"} 2023-07-18 18:12:10,451 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703930450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703930450"}]},"ts":"1689703930450"} 2023-07-18 18:12:10,459 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-18 18:12:10,460 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-18 18:12:10,460 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703930460"}]},"ts":"1689703930460"} 2023-07-18 18:12:10,463 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-18 18:12:10,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-18 18:12:10,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-18 18:12:10,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-18 18:12:10,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-18 18:12:10,470 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-18 18:12:10,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, ASSIGN}] 2023-07-18 18:12:10,474 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, ASSIGN 2023-07-18 18:12:10,474 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, ASSIGN 2023-07-18 18:12:10,475 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38743,1689703817702; forceNewPlan=false, retain=false 2023-07-18 18:12:10,476 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33749,1689703817568; forceNewPlan=false, retain=false 2023-07-18 18:12:10,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:10,625 INFO [jenkins-hbase4:41889] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-18 18:12:10,629 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=140720173fe28a76d69330d35a1b1b19, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:10,629 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703930629"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703930629"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703930629"}]},"ts":"1689703930629"} 2023-07-18 18:12:10,630 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=029e2679c74afa78798df3b423ab3838, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:10,630 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703930630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703930630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703930630"}]},"ts":"1689703930630"} 2023-07-18 18:12:10,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 140720173fe28a76d69330d35a1b1b19, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:12:10,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 029e2679c74afa78798df3b423ab3838, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:12:10,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 029e2679c74afa78798df3b423ab3838, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.', STARTKEY => '', ENDKEY => '1'} 2023-07-18 18:12:10,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. service=AccessControlService 2023-07-18 18:12:10,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:12:10,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:10,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 140720173fe28a76d69330d35a1b1b19, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.', STARTKEY => '1', ENDKEY => ''} 2023-07-18 18:12:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. service=AccessControlService 2023-07-18 18:12:10,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-18 18:12:10,819 INFO [StoreOpener-029e2679c74afa78798df3b423ab3838-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-18 18:12:10,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,822 DEBUG [StoreOpener-029e2679c74afa78798df3b423ab3838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf 2023-07-18 18:12:10,822 DEBUG [StoreOpener-029e2679c74afa78798df3b423ab3838-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf 2023-07-18 18:12:10,822 INFO [StoreOpener-029e2679c74afa78798df3b423ab3838-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 029e2679c74afa78798df3b423ab3838 columnFamilyName cf 2023-07-18 18:12:10,823 INFO [StoreOpener-029e2679c74afa78798df3b423ab3838-1] regionserver.HStore(310): Store=029e2679c74afa78798df3b423ab3838/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:12:10,833 INFO [StoreOpener-140720173fe28a76d69330d35a1b1b19-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,836 DEBUG [StoreOpener-140720173fe28a76d69330d35a1b1b19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf 2023-07-18 18:12:10,836 DEBUG [StoreOpener-140720173fe28a76d69330d35a1b1b19-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf 2023-07-18 18:12:10,837 INFO [StoreOpener-140720173fe28a76d69330d35a1b1b19-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 140720173fe28a76d69330d35a1b1b19 columnFamilyName cf 2023-07-18 18:12:10,838 INFO [StoreOpener-140720173fe28a76d69330d35a1b1b19-1] regionserver.HStore(310): Store=140720173fe28a76d69330d35a1b1b19/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-18 18:12:10,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:10,845 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:10,859 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:12:10,859 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 029e2679c74afa78798df3b423ab3838; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63816767, jitterRate=-0.04905606806278229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:12:10,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 029e2679c74afa78798df3b423ab3838: 2023-07-18 18:12:10,860 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838., pid=109, masterSystemTime=1689703930794 2023-07-18 18:12:10,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:10,863 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=029e2679c74afa78798df3b423ab3838, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:10,863 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703930863"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703930863"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703930863"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703930863"}]},"ts":"1689703930863"} 2023-07-18 18:12:10,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:10,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-18 18:12:10,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 029e2679c74afa78798df3b423ab3838, server=jenkins-hbase4.apache.org,33749,1689703817568 in 227 msec 2023-07-18 18:12:10,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, ASSIGN in 397 msec 2023-07-18 18:12:10,873 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-18 18:12:10,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 140720173fe28a76d69330d35a1b1b19; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58762338, jitterRate=-0.1243729293346405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-18 18:12:10,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 140720173fe28a76d69330d35a1b1b19: 2023-07-18 18:12:10,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19., pid=108, masterSystemTime=1689703930792 2023-07-18 18:12:10,880 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=140720173fe28a76d69330d35a1b1b19, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:10,880 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703930880"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689703930880"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689703930880"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689703930880"}]},"ts":"1689703930880"} 2023-07-18 18:12:10,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:10,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-18 18:12:10,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 140720173fe28a76d69330d35a1b1b19, server=jenkins-hbase4.apache.org,38743,1689703817702 in 246 msec 2023-07-18 18:12:10,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-18 18:12:10,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, ASSIGN in 414 msec 2023-07-18 18:12:10,887 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-18 18:12:10,887 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703930887"}]},"ts":"1689703930887"} 2023-07-18 18:12:10,889 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-18 18:12:10,891 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-18 18:12:10,892 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-18 18:12:10,894 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 18:12:10,895 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,896 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,896 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,896 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:10,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:10,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:10,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:10,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-18 18:12:10,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 646 msec 2023-07-18 18:12:11,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-18 18:12:11,365 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-18 18:12:11,366 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-18 18:12:11,366 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:11,369 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-18 18:12:11,369 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:11,369 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-18 18:12:11,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:11,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703931372 (current time:1689703931372). 2023-07-18 18:12:11,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:12:11,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x62e5d6f8 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:11,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4caa5957, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:11,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:11,386 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:11,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62e5d6f8 to 127.0.0.1:55531 2023-07-18 18:12:11,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:11,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x5b8b1d6e to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:11,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@179542f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:11,400 DEBUG [hconnection-0x96bd1b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:11,401 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:11,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5b8b1d6e to 127.0.0.1:55531 2023-07-18 18:12:11,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:11,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 18:12:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:12:11,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:11,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:11,414 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:11,415 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689704531415 2023-07-18 18:12:11,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:11,423 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,425 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:12:11,425 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:12:11,426 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:11,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:11,431 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 17 msec 2023-07-18 18:12:11,432 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:11,436 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689704531436 2023-07-18 18:12:11,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,480 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 18:12:11,480 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:11,482 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 18:12:11,482 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 18:12:11,511 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,511 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,513 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:11,513 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:11,513 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:11,513 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:11,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:11,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:11,513 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,513 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,514 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,514 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:11,518 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,519 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:11,519 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:11,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,521 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:11,521 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:11,521 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:11,522 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:11,522 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:11,523 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:11,523 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,526 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:11,527 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:11,527 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:11,528 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:11,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:11,529 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:12:11,530 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,530 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:11,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:11,531 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,531 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,531 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,531 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:11,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:11,532 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:11,532 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:11,532 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,532 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,532 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:11,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ce11fa[Count = 1] remaining members to acquire global barrier 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:11,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:11,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:11,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ce11fa[Count = 0] remaining members to acquire global barrier 2023-07-18 18:12:11,536 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 18:12:11,536 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,539 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,539 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:11,540 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:11,540 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:11,540 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:12:11,540 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,542 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:11,542 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:11,542 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:11,545 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,545 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:12:11,546 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:11,546 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:11,547 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:11,547 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. started... 2023-07-18 18:12:11,551 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:11,551 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:11,554 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:11,554 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 029e2679c74afa78798df3b423ab3838: 2023-07-18 18:12:11,554 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. started... 2023-07-18 18:12:11,554 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,554 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:11,554 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:12:11,557 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 140720173fe28a76d69330d35a1b1b19: 2023-07-18 18:12:11,557 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,557 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:11,557 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-18 18:12:11,631 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. completed. 2023-07-18 18:12:11,631 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:11,631 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:11,631 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:11,631 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,631 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:11,631 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:12:11,634 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:11,634 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:11,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:11,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,658 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. completed. 2023-07-18 18:12:11,658 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:11,658 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:11,658 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:11,658 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,659 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:11,659 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:12:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,662 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,662 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:11,662 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:11,662 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38743,1689703817702': 2023-07-18 18:12:11,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 18:12:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:12:11,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 18:12:11,676 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 18:12:11,676 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:12:11,676 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:12:11,676 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,676 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,679 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:11,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:11,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:11,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:11,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:11,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,693 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,694 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:11,695 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:11,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,697 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,698 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,700 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:11,708 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:11,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:11,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:11,708 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:11,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:11,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,708 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,710 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:11,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:11,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,711 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:11,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:11,729 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:11,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:11,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:11,731 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:12:11,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 18:12:11,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,808 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:11,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689703931423Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703931710 (+287 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703931711 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703931725 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689703931743 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689703931807 (+64 ms) 2023-07-18 18:12:11,812 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:11,814 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 387 msec 2023-07-18 18:12:12,031 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:12,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:12,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:12:12,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33749] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:12:12,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38743] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. with WAL disabled. Data may be lost in the event of a crash. 2023-07-18 18:12:12,060 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,060 DEBUG [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:12,061 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-18 18:12:12,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:12,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689703932084 (current time:1689703932084). 2023-07-18 18:12:12,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-18 18:12:12,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x5fb88ca9 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:12,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8091892, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:12,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:12,124 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:12,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fb88ca9 to 127.0.0.1:55531 2023-07-18 18:12:12,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:12,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(139): Connect 0x13f883b9 to 127.0.0.1:55531 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-18 18:12:12,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8be88ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-18 18:12:12,139 DEBUG [hconnection-0x4833cca6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-18 18:12:12,143 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-18 18:12:12,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13f883b9 to 127.0.0.1:55531 2023-07-18 18:12:12,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:12,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-18 18:12:12,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-18 18:12:12,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:12,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:12,159 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:12,162 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689704532162 2023-07-18 18:12:12,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-18 18:12:12,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,164 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-18 18:12:12,164 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-18 18:12:12,166 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-18 18:12:12,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:12,167 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 11 msec 2023-07-18 18:12:12,169 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:12,170 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689704532170 2023-07-18 18:12:12,197 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,197 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-18 18:12:12,197 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:12,200 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-18 18:12:12,200 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-18 18:12:12,202 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,202 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,204 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:12,204 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:12,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:12,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:12,204 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:12,204 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:12,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,204 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,205 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,205 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,205 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-18 18:12:12,205 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 18:12:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-18 18:12:12,206 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,206 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:12,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,206 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:12,206 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:12,208 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:12,208 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:12,208 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-18 18:12:12,208 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:12,209 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,209 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,210 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:12,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33749,1689703817568' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:12,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77b67f5a[Count = 1] remaining members to acquire global barrier 2023-07-18 18:12:12,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-18 18:12:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-18 18:12:12,216 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:12,217 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-18 18:12:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-18 18:12:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39363,1689703817431' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-18 18:12:12,221 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,221 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:12,221 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,221 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,221 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:12,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:12,223 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,223 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-18 18:12:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:12,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38743,1689703817702' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-18 18:12:12,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77b67f5a[Count = 0] remaining members to acquire global barrier 2023-07-18 18:12:12,231 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-18 18:12:12,231 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,239 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,239 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,240 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,240 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:12,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,240 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:12,240 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:12,240 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:12,240 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:12,240 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:12,240 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. started... 2023-07-18 18:12:12,240 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,241 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-18 18:12:12,240 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-18 18:12:12,241 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,241 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 140720173fe28a76d69330d35a1b1b19 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-18 18:12:12,240 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. started... 2023-07-18 18:12:12,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,241 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-18 18:12:12,241 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 029e2679c74afa78798df3b423ab3838 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-18 18:12:12,241 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-18 18:12:12,241 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:12,241 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39363,1689703817431' in zk 2023-07-18 18:12:12,243 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:12,243 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:12,243 DEBUG [member: 'jenkins-hbase4.apache.org,39363,1689703817431' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:12,264 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:12,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:12,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:12,266 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-18 18:12:12,270 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/.tmp/cf/0d831dbc22c04048bdd26b2de37d28cf 2023-07-18 18:12:12,273 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/.tmp/cf/e53b258cf4404ec3acfee92a65f12d71 2023-07-18 18:12:12,277 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/.tmp/cf/0d831dbc22c04048bdd26b2de37d28cf as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf/0d831dbc22c04048bdd26b2de37d28cf 2023-07-18 18:12:12,280 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/.tmp/cf/e53b258cf4404ec3acfee92a65f12d71 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf/e53b258cf4404ec3acfee92a65f12d71 2023-07-18 18:12:12,284 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf/0d831dbc22c04048bdd26b2de37d28cf, entries=47, sequenceid=6, filesize=8.0 K 2023-07-18 18:12:12,289 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf/e53b258cf4404ec3acfee92a65f12d71, entries=3, sequenceid=6, filesize=5.0 K 2023-07-18 18:12:12,289 INFO [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 140720173fe28a76d69330d35a1b1b19 in 48ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:12,289 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-18 18:12:12,290 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 140720173fe28a76d69330d35a1b1b19: 2023-07-18 18:12:12,290 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,290 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:12,290 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf/0d831dbc22c04048bdd26b2de37d28cf] hfiles 2023-07-18 18:12:12,290 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf/0d831dbc22c04048bdd26b2de37d28cf for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,290 INFO [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 029e2679c74afa78798df3b423ab3838 in 49ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:12,292 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 029e2679c74afa78798df3b423ab3838: 2023-07-18 18:12:12,292 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,293 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-18 18:12:12,293 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf/e53b258cf4404ec3acfee92a65f12d71] hfiles 2023-07-18 18:12:12,293 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf/e53b258cf4404ec3acfee92a65f12d71 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,343 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. completed. 2023-07-18 18:12:12,343 DEBUG [rs(jenkins-hbase4.apache.org,38743,1689703817702)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:12,343 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:12,343 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:12,343 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:12,351 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38743,1689703817702' in zk 2023-07-18 18:12:12,353 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,353 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:12,353 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:12,353 DEBUG [member: 'jenkins-hbase4.apache.org,38743,1689703817702' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:12,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:12,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:12,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:12,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,357 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. completed. 2023-07-18 18:12:12,357 DEBUG [rs(jenkins-hbase4.apache.org,33749,1689703817568)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:12,357 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-18 18:12:12,357 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-18 18:12:12,357 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-18 18:12:12,358 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33749,1689703817568' in zk 2023-07-18 18:12:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,359 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-18 18:12:12,360 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:12,360 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,360 DEBUG [member: 'jenkins-hbase4.apache.org,33749,1689703817568' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-18 18:12:12,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38743,1689703817702': 2023-07-18 18:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38743,1689703817702' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-18 18:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:12,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:12,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33749,1689703817568': 2023-07-18 18:12:12,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33749,1689703817568' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-18 18:12:12,383 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-18 18:12:12,383 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-18 18:12:12,383 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-18 18:12:12,383 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,383 INFO [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-18 18:12:12,386 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:12,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-18 18:12:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-18 18:12:12,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,386 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,387 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:12,386 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:12,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-18 18:12:12,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:12,388 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,389 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-18 18:12:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,389 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-18 18:12:12,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,391 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,392 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,392 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,396 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:12,396 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:12,396 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:12,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:12,396 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:12,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:12,396 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:12,396 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:12,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-18 18:12:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-18 18:12:12,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:12,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,397 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:12,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-18 18:12:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-18 18:12:12,398 DEBUG [(jenkins-hbase4.apache.org,41889,1689703815990)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-18 18:12:12,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,400 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,466 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:12,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:12,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-18 18:12:12,467 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-18 18:12:12,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,529 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-18 18:12:12,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,529 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,530 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689703932162Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689703932400 (+238 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689703932400Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689703932405 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689703932456 (+51 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689703932529 (+73 ms) 2023-07-18 18:12:12,533 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-18 18:12:12,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 369 msec 2023-07-18 18:12:12,767 DEBUG [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-18 18:12:12,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-18 18:12:12,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-18 18:12:12,769 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769 2023-07-18 18:12:12,769 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43971, tgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769, rawTgtDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769, srcFsUri=hdfs://localhost:43971, srcDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:12:12,802 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51 2023-07-18 18:12:12,802 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1844739329_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,803 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43971, inputRoot=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51, snapshotDir=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-18 18:12:12,817 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:12,846 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,846 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,847 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,847 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,847 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,848 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,848 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,924 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/hadoop-6645913155419709104.jar 2023-07-18 18:12:12,924 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,925 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,925 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,926 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,926 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,927 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-18 18:12:12,927 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-18 18:12:12,928 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-18 18:12:12,929 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-18 18:12:12,929 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-18 18:12:12,930 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-18 18:12:12,930 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-18 18:12:12,931 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-18 18:12:12,931 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-18 18:12:12,932 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-18 18:12:12,932 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-18 18:12:12,933 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:12,935 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-18 18:12:12,935 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:12,936 DEBUG [Listener at jenkins-hbase4.apache.org/45437] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-18 18:12:14,042 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0006_000001 (auth:SIMPLE) 2023-07-18 18:12:14,057 WARN [Listener at jenkins-hbase4.apache.org/45437] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-18 18:12:14,060 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-18 18:12:14,062 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-18 18:12:14,129 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:14,129 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-18 18:12:15,054 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:15,557 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:12:20,176 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:22,571 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:26,898 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689703825606_0007_000001 (auth:SIMPLE) 2023-07-18 18:12:28,295 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-18 18:12:28,295 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-18 18:12:28,336 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,336 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-18 18:12:28,337 INFO [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-18 18:12:28,337 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,337 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 18:12:28,338 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 18:12:28,338 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_552096123_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,339 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-18 18:12:28,339 DEBUG [Listener at jenkins-hbase4.apache.org/45437] snapshot.TestExportSnapshot(367): hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/export-test/export-1689703932769/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-18 18:12:28,358 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 18:12:28,365 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703948365"}]},"ts":"1689703948365"} 2023-07-18 18:12:28,366 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-18 18:12:28,370 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-18 18:12:28,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, UNASSIGN}] 2023-07-18 18:12:28,373 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, UNASSIGN 2023-07-18 18:12:28,374 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, UNASSIGN 2023-07-18 18:12:28,375 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=140720173fe28a76d69330d35a1b1b19, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:28,375 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703948374"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703948374"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703948374"}]},"ts":"1689703948374"} 2023-07-18 18:12:28,375 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=029e2679c74afa78798df3b423ab3838, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:28,375 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703948375"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689703948375"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689703948375"}]},"ts":"1689703948375"} 2023-07-18 18:12:28,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 140720173fe28a76d69330d35a1b1b19, server=jenkins-hbase4.apache.org,38743,1689703817702}] 2023-07-18 18:12:28,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 029e2679c74afa78798df3b423ab3838, server=jenkins-hbase4.apache.org,33749,1689703817568}] 2023-07-18 18:12:28,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 18:12:28,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:28,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 140720173fe28a76d69330d35a1b1b19, disabling compactions & flushes 2023-07-18 18:12:28,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:28,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:28,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. after waiting 0 ms 2023-07-18 18:12:28,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:28,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:28,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 029e2679c74afa78798df3b423ab3838, disabling compactions & flushes 2023-07-18 18:12:28,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:28,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:28,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. after waiting 0 ms 2023-07-18 18:12:28,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:28,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:28,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:28,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:28,572 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838. 2023-07-18 18:12:28,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 029e2679c74afa78798df3b423ab3838: 2023-07-18 18:12:28,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:28,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19. 2023-07-18 18:12:28,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 140720173fe28a76d69330d35a1b1b19: 2023-07-18 18:12:28,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:28,576 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=029e2679c74afa78798df3b423ab3838, regionState=CLOSED 2023-07-18 18:12:28,577 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703948576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703948576"}]},"ts":"1689703948576"} 2023-07-18 18:12:28,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=140720173fe28a76d69330d35a1b1b19, regionState=CLOSED 2023-07-18 18:12:28,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689703948578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689703948578"}]},"ts":"1689703948578"} 2023-07-18 18:12:28,579 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:28,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-18 18:12:28,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-18 18:12:28,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 029e2679c74afa78798df3b423ab3838, server=jenkins-hbase4.apache.org,33749,1689703817568 in 197 msec 2023-07-18 18:12:28,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 140720173fe28a76d69330d35a1b1b19, server=jenkins-hbase4.apache.org,38743,1689703817702 in 199 msec 2023-07-18 18:12:28,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=029e2679c74afa78798df3b423ab3838, UNASSIGN in 213 msec 2023-07-18 18:12:28,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-18 18:12:28,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=140720173fe28a76d69330d35a1b1b19, UNASSIGN in 213 msec 2023-07-18 18:12:28,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689703948587"}]},"ts":"1689703948587"} 2023-07-18 18:12:28,589 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-18 18:12:28,590 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-18 18:12:28,592 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 233 msec 2023-07-18 18:12:28,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-18 18:12:28,668 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-18 18:12:28,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,679 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,680 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,683 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38743] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,685 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:28,685 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:28,686 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,686 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,686 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,686 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:28,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:28,687 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:28,688 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/recovered.edits] 2023-07-18 18:12:28,688 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-18 18:12:28,688 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf, FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/recovered.edits] 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,689 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-18 18:12:28,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 18:12:28,692 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf/e53b258cf4404ec3acfee92a65f12d71 to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/cf/e53b258cf4404ec3acfee92a65f12d71 2023-07-18 18:12:28,693 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf/0d831dbc22c04048bdd26b2de37d28cf to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/cf/0d831dbc22c04048bdd26b2de37d28cf 2023-07-18 18:12:28,698 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838/recovered.edits/9.seqid 2023-07-18 18:12:28,698 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/029e2679c74afa78798df3b423ab3838 2023-07-18 18:12:28,699 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/recovered.edits/9.seqid to hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19/recovered.edits/9.seqid 2023-07-18 18:12:28,699 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/140720173fe28a76d69330d35a1b1b19 2023-07-18 18:12:28,699 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-18 18:12:28,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,705 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-18 18:12:28,707 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-18 18:12:28,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-18 18:12:28,708 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703948708"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:28,709 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689703948708"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:28,710 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-18 18:12:28,710 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 029e2679c74afa78798df3b423ab3838, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689703930254.029e2679c74afa78798df3b423ab3838.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 140720173fe28a76d69330d35a1b1b19, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689703930254.140720173fe28a76d69330d35a1b1b19.', STARTKEY => '1', ENDKEY => ''}] 2023-07-18 18:12:28,711 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-18 18:12:28,711 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689703948711"}]},"ts":"9223372036854775807"} 2023-07-18 18:12:28,713 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-18 18:12:28,715 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 46 msec 2023-07-18 18:12:28,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-18 18:12:28,793 INFO [Listener at jenkins-hbase4.apache.org/45437] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-18 18:12:28,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 18:12:28,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-18 18:12:28,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41889] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-18 18:12:28,859 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 763) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1518229747_1 at /127.0.0.1:52180 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5200 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:46492 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:54746 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x730b4be8-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_552096123_17 at /127.0.0.1:52210 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1348317003) connection to jenkins-hbase4.apache.org/172.31.14.131:36917 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=898 (was 918), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=625 (was 572) - SystemLoadAverage LEAK? -, ProcessCount=187 (was 187), AvailableMemoryMB=1479 (was 1355) - AvailableMemoryMB LEAK? - 2023-07-18 18:12:28,859 WARN [Listener at jenkins-hbase4.apache.org/45437] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-18 18:12:28,860 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-18 18:12:28,877 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:12:29,012 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689703825606_0007_01_000001 is : 143 2023-07-18 18:12:34,159 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-18 18:12:43,015 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:12:57,137 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 18:12:57,138 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:12:57,253 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-18 18:12:57,268 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-18 18:12:57,269 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 18:12:57,297 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-18 18:12:57,402 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-18 18:12:57,402 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-18 18:12:57,403 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-18 18:12:57,403 INFO [Listener at jenkins-hbase4.apache.org/45437] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-18 18:12:57,403 DEBUG [Listener at jenkins-hbase4.apache.org/45437] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b4bf029 to 127.0.0.1:55531 2023-07-18 18:12:57,403 DEBUG [Listener at jenkins-hbase4.apache.org/45437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:57,403 DEBUG [Listener at jenkins-hbase4.apache.org/45437] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-18 18:12:57,403 DEBUG [Listener at jenkins-hbase4.apache.org/45437] util.JVMClusterUtil(257): Found active master hash=985255213, stopped=false 2023-07-18 18:12:57,403 DEBUG [Listener at jenkins-hbase4.apache.org/45437] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,404 DEBUG [Listener at jenkins-hbase4.apache.org/45437] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-18 18:12:57,404 INFO [Listener at jenkins-hbase4.apache.org/45437] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:12:57,405 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:12:57,405 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:12:57,405 INFO [Listener at jenkins-hbase4.apache.org/45437] procedure2.ProcedureExecutor(629): Stopping 2023-07-18 18:12:57,405 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:12:57,405 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:12:57,405 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-18 18:12:57,405 DEBUG [Listener at jenkins-hbase4.apache.org/45437] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x33e9ed81 to 127.0.0.1:55531 2023-07-18 18:12:57,406 DEBUG [Listener at jenkins-hbase4.apache.org/45437] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:57,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:12:57,406 INFO [Listener at jenkins-hbase4.apache.org/45437] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39363,1689703817431' ***** 2023-07-18 18:12:57,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:12:57,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:12:57,407 DEBUG [Listener at jenkins-hbase4.apache.org/45437] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,407 INFO [Listener at jenkins-hbase4.apache.org/45437] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:12:57,407 INFO [Listener at jenkins-hbase4.apache.org/45437] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33749,1689703817568' ***** 2023-07-18 18:12:57,407 DEBUG [Listener at jenkins-hbase4.apache.org/45437] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,407 INFO [Listener at jenkins-hbase4.apache.org/45437] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:12:57,407 INFO [RS:0;jenkins-hbase4:39363] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:12:57,407 INFO [RS:1;jenkins-hbase4:33749] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:12:57,407 INFO [RS:0;jenkins-hbase4:39363] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:12:57,407 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:12:57,407 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:12:57,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-18 18:12:57,407 INFO [Listener at jenkins-hbase4.apache.org/45437] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38743,1689703817702' ***** 2023-07-18 18:12:57,407 INFO [RS:0;jenkins-hbase4:39363] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:12:57,407 INFO [RS:1;jenkins-hbase4:33749] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:12:57,408 INFO [RS:1;jenkins-hbase4:33749] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:12:57,408 DEBUG [Listener at jenkins-hbase4.apache.org/45437] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,408 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(3305): Received CLOSE for e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:12:57,408 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:57,408 INFO [Listener at jenkins-hbase4.apache.org/45437] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-18 18:12:57,408 DEBUG [RS:1;jenkins-hbase4:33749] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39b14ca9 to 127.0.0.1:55531 2023-07-18 18:12:57,408 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:57,408 DEBUG [RS:1;jenkins-hbase4:33749] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:57,408 DEBUG [RS:0;jenkins-hbase4:39363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x668f84dc to 127.0.0.1:55531 2023-07-18 18:12:57,410 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33749,1689703817568; all regions closed. 2023-07-18 18:12:57,410 INFO [RS:2;jenkins-hbase4:38743] regionserver.HeapMemoryManager(220): Stopping 2023-07-18 18:12:57,410 DEBUG [RS:0;jenkins-hbase4:39363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:57,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e644a00a8889d67b87d5f691cbd8f825, disabling compactions & flushes 2023-07-18 18:12:57,410 INFO [RS:2;jenkins-hbase4:38743] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-18 18:12:57,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:12:57,411 INFO [RS:2;jenkins-hbase4:38743] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-18 18:12:57,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:12:57,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. after waiting 0 ms 2023-07-18 18:12:57,411 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(3305): Received CLOSE for 7b13b8097114f6c946827d0018950962 2023-07-18 18:12:57,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:12:57,411 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:57,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing e644a00a8889d67b87d5f691cbd8f825 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-18 18:12:57,411 DEBUG [RS:2;jenkins-hbase4:38743] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5764687d to 127.0.0.1:55531 2023-07-18 18:12:57,411 DEBUG [RS:2;jenkins-hbase4:38743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:57,411 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-18 18:12:57,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7b13b8097114f6c946827d0018950962, disabling compactions & flushes 2023-07-18 18:12:57,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:12:57,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:12:57,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. after waiting 0 ms 2023-07-18 18:12:57,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:12:57,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7b13b8097114f6c946827d0018950962 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-18 18:12:57,414 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-18 18:12:57,414 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1478): Online Regions={e644a00a8889d67b87d5f691cbd8f825=hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825.} 2023-07-18 18:12:57,420 INFO [RS:2;jenkins-hbase4:38743] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:12:57,420 INFO [RS:2;jenkins-hbase4:38743] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:12:57,420 INFO [RS:2;jenkins-hbase4:38743] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:12:57,421 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-18 18:12:57,421 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1504): Waiting on e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:12:57,422 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-18 18:12:57,422 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1478): Online Regions={7b13b8097114f6c946827d0018950962=hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962., 1588230740=hbase:meta,,1.1588230740} 2023-07-18 18:12:57,423 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1504): Waiting on 1588230740, 7b13b8097114f6c946827d0018950962 2023-07-18 18:12:57,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-18 18:12:57,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-18 18:12:57,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-18 18:12:57,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-18 18:12:57,423 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-18 18:12:57,423 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-18 18:12:57,434 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:12:57,437 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:12:57,441 DEBUG [RS:1;jenkins-hbase4:33749] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs 2023-07-18 18:12:57,441 INFO [RS:1;jenkins-hbase4:33749] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33749%2C1689703817568:(num 1689703820448) 2023-07-18 18:12:57,441 DEBUG [RS:1;jenkins-hbase4:33749] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:57,441 INFO [RS:1;jenkins-hbase4:33749] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:12:57,445 INFO [RS:1;jenkins-hbase4:33749] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:12:57,445 INFO [RS:1;jenkins-hbase4:33749] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:12:57,445 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:12:57,445 INFO [RS:1;jenkins-hbase4:33749] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:12:57,445 INFO [RS:1;jenkins-hbase4:33749] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:12:57,447 INFO [RS:1;jenkins-hbase4:33749] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33749 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33749,1689703817568 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:12:57,455 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:12:57,455 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33749,1689703817568] 2023-07-18 18:12:57,456 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33749,1689703817568; numProcessing=1 2023-07-18 18:12:57,458 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33749,1689703817568 already deleted, retry=false 2023-07-18 18:12:57,458 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33749,1689703817568 expired; onlineServers=2 2023-07-18 18:12:57,461 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/.tmp/info/e023b0c57f5e4db7b2e0558aad405e86 2023-07-18 18:12:57,466 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e023b0c57f5e4db7b2e0558aad405e86 2023-07-18 18:12:57,469 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:12:57,480 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/.tmp/rep_barrier/ebe2ec3adf33486da720fe403dd9821a 2023-07-18 18:12:57,485 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebe2ec3adf33486da720fe403dd9821a 2023-07-18 18:12:57,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/.tmp/table/4f1b354077a94ecc9c61ec3973c157c7 2023-07-18 18:12:57,501 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f1b354077a94ecc9c61ec3973c157c7 2023-07-18 18:12:57,502 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/.tmp/info/e023b0c57f5e4db7b2e0558aad405e86 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/info/e023b0c57f5e4db7b2e0558aad405e86 2023-07-18 18:12:57,506 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e023b0c57f5e4db7b2e0558aad405e86 2023-07-18 18:12:57,507 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/info/e023b0c57f5e4db7b2e0558aad405e86, entries=48, sequenceid=131, filesize=10.3 K 2023-07-18 18:12:57,507 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/.tmp/rep_barrier/ebe2ec3adf33486da720fe403dd9821a as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/rep_barrier/ebe2ec3adf33486da720fe403dd9821a 2023-07-18 18:12:57,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebe2ec3adf33486da720fe403dd9821a 2023-07-18 18:12:57,512 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/rep_barrier/ebe2ec3adf33486da720fe403dd9821a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-18 18:12:57,513 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/.tmp/table/4f1b354077a94ecc9c61ec3973c157c7 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/table/4f1b354077a94ecc9c61ec3973c157c7 2023-07-18 18:12:57,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f1b354077a94ecc9c61ec3973c157c7 2023-07-18 18:12:57,518 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/table/4f1b354077a94ecc9c61ec3973c157c7, entries=24, sequenceid=131, filesize=6.9 K 2023-07-18 18:12:57,525 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 101ms, sequenceid=131, compaction requested=false 2023-07-18 18:12:57,544 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-18 18:12:57,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,545 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-18 18:12:57,546 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-18 18:12:57,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-18 18:12:57,546 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-18 18:12:57,557 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:57,557 INFO [RS:1;jenkins-hbase4:33749] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33749,1689703817568; zookeeper connection closed. 2023-07-18 18:12:57,557 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:33749-0x10179a09a920002, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:57,557 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2d6dc23] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2d6dc23 2023-07-18 18:12:57,621 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1504): Waiting on e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:12:57,623 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1504): Waiting on 7b13b8097114f6c946827d0018950962 2023-07-18 18:12:57,821 DEBUG [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1504): Waiting on e644a00a8889d67b87d5f691cbd8f825 2023-07-18 18:12:57,824 DEBUG [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1504): Waiting on 7b13b8097114f6c946827d0018950962 2023-07-18 18:12:57,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/.tmp/info/7a57b58f0f6b4af389f4c57b9df915c2 2023-07-18 18:12:57,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/.tmp/l/3bbef29d99c546909b1bbd43c27ec1d1 2023-07-18 18:12:57,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/.tmp/info/7a57b58f0f6b4af389f4c57b9df915c2 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/info/7a57b58f0f6b4af389f4c57b9df915c2 2023-07-18 18:12:57,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bbef29d99c546909b1bbd43c27ec1d1 2023-07-18 18:12:57,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/.tmp/l/3bbef29d99c546909b1bbd43c27ec1d1 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/l/3bbef29d99c546909b1bbd43c27ec1d1 2023-07-18 18:12:57,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3bbef29d99c546909b1bbd43c27ec1d1 2023-07-18 18:12:57,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/l/3bbef29d99c546909b1bbd43c27ec1d1, entries=7, sequenceid=18, filesize=5.2 K 2023-07-18 18:12:57,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/info/7a57b58f0f6b4af389f4c57b9df915c2, entries=2, sequenceid=6, filesize=4.8 K 2023-07-18 18:12:57,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 7b13b8097114f6c946827d0018950962 in 457ms, sequenceid=18, compaction requested=false 2023-07-18 18:12:57,879 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e644a00a8889d67b87d5f691cbd8f825 in 467ms, sequenceid=6, compaction requested=false 2023-07-18 18:12:57,905 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/namespace/e644a00a8889d67b87d5f691cbd8f825/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-18 18:12:57,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:12:57,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/data/hbase/acl/7b13b8097114f6c946827d0018950962/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-18 18:12:57,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e644a00a8889d67b87d5f691cbd8f825: 2023-07-18 18:12:57,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689703820927.e644a00a8889d67b87d5f691cbd8f825. 2023-07-18 18:12:57,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-18 18:12:57,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:12:57,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7b13b8097114f6c946827d0018950962: 2023-07-18 18:12:57,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689703821681.7b13b8097114f6c946827d0018950962. 2023-07-18 18:12:58,021 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39363,1689703817431; all regions closed. 2023-07-18 18:12:58,024 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38743,1689703817702; all regions closed. 2023-07-18 18:12:58,035 DEBUG [RS:0;jenkins-hbase4:39363] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs 2023-07-18 18:12:58,035 INFO [RS:0;jenkins-hbase4:39363] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39363%2C1689703817431:(num 1689703820435) 2023-07-18 18:12:58,035 DEBUG [RS:0;jenkins-hbase4:39363] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:58,036 INFO [RS:0;jenkins-hbase4:39363] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:12:58,036 INFO [RS:0;jenkins-hbase4:39363] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-18 18:12:58,037 INFO [RS:0;jenkins-hbase4:39363] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-18 18:12:58,037 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:12:58,037 INFO [RS:0;jenkins-hbase4:39363] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-18 18:12:58,037 INFO [RS:0;jenkins-hbase4:39363] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-18 18:12:58,038 INFO [RS:0;jenkins-hbase4:39363] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39363 2023-07-18 18:12:58,040 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:58,040 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:12:58,040 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39363,1689703817431 2023-07-18 18:12:58,041 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39363,1689703817431] 2023-07-18 18:12:58,041 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39363,1689703817431; numProcessing=2 2023-07-18 18:12:58,043 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39363,1689703817431 already deleted, retry=false 2023-07-18 18:12:58,043 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39363,1689703817431 expired; onlineServers=1 2023-07-18 18:12:58,045 DEBUG [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs 2023-07-18 18:12:58,045 INFO [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38743%2C1689703817702.meta:.meta(num 1689703820570) 2023-07-18 18:12:58,056 DEBUG [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/oldWALs 2023-07-18 18:12:58,056 INFO [RS:2;jenkins-hbase4:38743] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38743%2C1689703817702:(num 1689703820438) 2023-07-18 18:12:58,056 DEBUG [RS:2;jenkins-hbase4:38743] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:58,056 INFO [RS:2;jenkins-hbase4:38743] regionserver.LeaseManager(133): Closed leases 2023-07-18 18:12:58,057 INFO [RS:2;jenkins-hbase4:38743] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-18 18:12:58,057 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:12:58,058 INFO [RS:2;jenkins-hbase4:38743] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38743 2023-07-18 18:12:58,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-18 18:12:58,060 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38743,1689703817702 2023-07-18 18:12:58,060 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38743,1689703817702] 2023-07-18 18:12:58,060 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38743,1689703817702; numProcessing=3 2023-07-18 18:12:58,062 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38743,1689703817702 already deleted, retry=false 2023-07-18 18:12:58,062 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38743,1689703817702 expired; onlineServers=0 2023-07-18 18:12:58,062 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41889,1689703815990' ***** 2023-07-18 18:12:58,062 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-18 18:12:58,062 DEBUG [M:0;jenkins-hbase4:41889] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b84c716, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-18 18:12:58,062 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41889,1689703815990 2023-07-18 18:12:58,062 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41889,1689703815990; all regions closed. 2023-07-18 18:12:58,062 DEBUG [M:0;jenkins-hbase4:41889] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-18 18:12:58,063 DEBUG [M:0;jenkins-hbase4:41889] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-18 18:12:58,063 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-18 18:12:58,063 DEBUG [M:0;jenkins-hbase4:41889] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-18 18:12:58,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689703819860] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689703819860,5,FailOnTimeoutGroup] 2023-07-18 18:12:58,063 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689703819854] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689703819854,5,FailOnTimeoutGroup] 2023-07-18 18:12:58,063 INFO [M:0;jenkins-hbase4:41889] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-18 18:12:58,063 INFO [M:0;jenkins-hbase4:41889] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-18 18:12:58,063 INFO [M:0;jenkins-hbase4:41889] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-18 18:12:58,063 DEBUG [M:0;jenkins-hbase4:41889] master.HMaster(1512): Stopping service threads 2023-07-18 18:12:58,063 INFO [M:0;jenkins-hbase4:41889] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-18 18:12:58,064 ERROR [M:0;jenkins-hbase4:41889] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-18 18:12:58,064 INFO [M:0;jenkins-hbase4:41889] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-18 18:12:58,064 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-18 18:12:58,065 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-18 18:12:58,065 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-18 18:12:58,065 DEBUG [M:0;jenkins-hbase4:41889] zookeeper.ZKUtil(398): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-18 18:12:58,065 WARN [M:0;jenkins-hbase4:41889] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-18 18:12:58,065 INFO [M:0;jenkins-hbase4:41889] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-18 18:12:58,065 INFO [M:0;jenkins-hbase4:41889] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-18 18:12:58,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-18 18:12:58,066 DEBUG [M:0;jenkins-hbase4:41889] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-18 18:12:58,066 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:12:58,066 DEBUG [M:0;jenkins-hbase4:41889] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:12:58,066 DEBUG [M:0;jenkins-hbase4:41889] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-18 18:12:58,066 DEBUG [M:0;jenkins-hbase4:41889] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:12:58,067 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.12 KB heapSize=449.38 KB 2023-07-18 18:12:58,096 INFO [M:0;jenkins-hbase4:41889] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.12 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7f3e937d7334850a473d1d9627e09e5 2023-07-18 18:12:58,101 INFO [M:0;jenkins-hbase4:41889] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7f3e937d7334850a473d1d9627e09e5 2023-07-18 18:12:58,102 DEBUG [M:0;jenkins-hbase4:41889] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f7f3e937d7334850a473d1d9627e09e5 as hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7f3e937d7334850a473d1d9627e09e5 2023-07-18 18:12:58,106 INFO [M:0;jenkins-hbase4:41889] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7f3e937d7334850a473d1d9627e09e5 2023-07-18 18:12:58,107 INFO [M:0;jenkins-hbase4:41889] regionserver.HStore(1080): Added hdfs://localhost:43971/user/jenkins/test-data/9639fafe-30cd-03e2-6bbd-44013fa63d51/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f7f3e937d7334850a473d1d9627e09e5, entries=119, sequenceid=899, filesize=28.4 K 2023-07-18 18:12:58,107 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegion(2948): Finished flush of dataSize ~373.12 KB/382072, heapSize ~449.37 KB/460152, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 41ms, sequenceid=899, compaction requested=false 2023-07-18 18:12:58,109 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-18 18:12:58,109 DEBUG [M:0;jenkins-hbase4:41889] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-18 18:12:58,113 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-18 18:12:58,113 INFO [M:0;jenkins-hbase4:41889] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-18 18:12:58,114 INFO [M:0;jenkins-hbase4:41889] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41889 2023-07-18 18:12:58,116 DEBUG [M:0;jenkins-hbase4:41889] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41889,1689703815990 already deleted, retry=false 2023-07-18 18:12:58,141 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:58,141 INFO [RS:0;jenkins-hbase4:39363] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39363,1689703817431; zookeeper connection closed. 2023-07-18 18:12:58,141 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:39363-0x10179a09a920001, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:58,142 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c38925] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c38925 2023-07-18 18:12:58,242 INFO [M:0;jenkins-hbase4:41889] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41889,1689703815990; zookeeper connection closed. 2023-07-18 18:12:58,242 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:58,242 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): master:41889-0x10179a09a920000, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:58,342 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:58,342 DEBUG [Listener at localhost/36595-EventThread] zookeeper.ZKWatcher(600): regionserver:38743-0x10179a09a920003, quorum=127.0.0.1:55531, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-18 18:12:58,342 INFO [RS:2;jenkins-hbase4:38743] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38743,1689703817702; zookeeper connection closed. 2023-07-18 18:12:58,343 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@265cbe55] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@265cbe55 2023-07-18 18:12:58,343 INFO [Listener at jenkins-hbase4.apache.org/45437] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-18 18:12:58,343 WARN [Listener at jenkins-hbase4.apache.org/45437] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:12:58,360 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:12:58,464 WARN [BP-502592648-172.31.14.131-1689703811913 heartbeating to localhost/127.0.0.1:43971] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:12:58,465 WARN [BP-502592648-172.31.14.131-1689703811913 heartbeating to localhost/127.0.0.1:43971] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-502592648-172.31.14.131-1689703811913 (Datanode Uuid 91a6329d-2b60-4984-a2d0-4b652011e923) service to localhost/127.0.0.1:43971 2023-07-18 18:12:58,467 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data5/current/BP-502592648-172.31.14.131-1689703811913] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:12:58,467 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data6/current/BP-502592648-172.31.14.131-1689703811913] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:12:58,496 WARN [Listener at jenkins-hbase4.apache.org/45437] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:12:58,512 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:12:58,615 WARN [BP-502592648-172.31.14.131-1689703811913 heartbeating to localhost/127.0.0.1:43971] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:12:58,615 WARN [BP-502592648-172.31.14.131-1689703811913 heartbeating to localhost/127.0.0.1:43971] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-502592648-172.31.14.131-1689703811913 (Datanode Uuid 24d90ede-13d7-426e-8649-48aa06e7553b) service to localhost/127.0.0.1:43971 2023-07-18 18:12:58,615 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data3/current/BP-502592648-172.31.14.131-1689703811913] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:12:58,616 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data4/current/BP-502592648-172.31.14.131-1689703811913] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:12:58,617 WARN [Listener at jenkins-hbase4.apache.org/45437] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-18 18:12:58,619 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:12:58,722 WARN [BP-502592648-172.31.14.131-1689703811913 heartbeating to localhost/127.0.0.1:43971] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-18 18:12:58,722 WARN [BP-502592648-172.31.14.131-1689703811913 heartbeating to localhost/127.0.0.1:43971] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-502592648-172.31.14.131-1689703811913 (Datanode Uuid 6150c56b-8cab-4f7f-b94b-36850696fcc5) service to localhost/127.0.0.1:43971 2023-07-18 18:12:58,723 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data1/current/BP-502592648-172.31.14.131-1689703811913] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:12:58,723 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/1b40ab4d-bc37-0fc8-73fe-0ea4ac145d7a/cluster_a8b72303-7fc7-911a-dd1d-b8d8985558e1/dfs/data/data2/current/BP-502592648-172.31.14.131-1689703811913] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-18 18:12:58,745 INFO [Listener at jenkins-hbase4.apache.org/45437] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-18 18:12:58,870 INFO [Listener at jenkins-hbase4.apache.org/45437] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-18 18:12:58,986 INFO [Listener at jenkins-hbase4.apache.org/45437] hbase.HBaseTestingUtility(1293): Minicluster is down