2023-09-13 02:59:23,126 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-13 02:59:23,329 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd 2023-09-13 02:59:23,329 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-13 02:59:23,330 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-13 02:59:23,374 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-13 02:59:23,637 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-13 02:59:23,637 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41, deleteOnExit=true 2023-09-13 02:59:23,638 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-13 02:59:23,638 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/test.cache.data in system properties and HBase conf 2023-09-13 02:59:23,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop.tmp.dir in system properties and HBase conf 2023-09-13 02:59:23,639 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop.log.dir in system properties and HBase conf 2023-09-13 02:59:23,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-13 02:59:23,640 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-13 02:59:23,641 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-13 02:59:23,951 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-13 02:59:23,956 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-13 02:59:23,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-13 02:59:23,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-13 02:59:23,957 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 02:59:23,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-13 02:59:23,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-13 02:59:23,958 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 02:59:23,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 02:59:23,959 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-13 02:59:23,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/nfs.dump.dir in system properties and HBase conf 2023-09-13 02:59:23,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir in system properties and HBase conf 2023-09-13 02:59:23,960 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 02:59:23,961 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-13 02:59:23,961 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-13 02:59:24,468 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-13 02:59:24,473 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-13 02:59:24,799 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-13 02:59:24,976 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-13 02:59:24,989 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:25,030 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:25,076 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_localhost_35785_hdfs____vqwn7g/webapp 2023-09-13 02:59:25,228 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35785 2023-09-13 02:59:25,267 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-13 02:59:25,267 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-13 02:59:25,730 WARN [Listener at localhost/34433] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 02:59:25,801 WARN [Listener at localhost/34433] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 02:59:25,823 WARN [Listener at localhost/34433] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:25,829 INFO [Listener at localhost/34433] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:25,835 INFO [Listener at localhost/34433] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_localhost_44611_datanode____.qbdcjn/webapp 2023-09-13 02:59:25,935 INFO [Listener at localhost/34433] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44611 2023-09-13 02:59:26,408 WARN [Listener at localhost/35983] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 02:59:26,425 WARN [Listener at localhost/35983] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 02:59:26,432 WARN [Listener at localhost/35983] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:26,434 INFO [Listener at localhost/35983] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:26,443 INFO [Listener at localhost/35983] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_localhost_43181_datanode____c15v8y/webapp 2023-09-13 02:59:26,568 INFO [Listener at localhost/35983] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43181 2023-09-13 02:59:26,576 WARN [Listener at localhost/41275] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 02:59:26,599 WARN [Listener at localhost/41275] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-13 02:59:26,603 WARN [Listener at localhost/41275] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:26,605 INFO [Listener at localhost/41275] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:26,618 INFO [Listener at localhost/41275] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_localhost_34833_datanode____.p9cdmq/webapp 2023-09-13 02:59:26,741 INFO [Listener at localhost/41275] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34833 2023-09-13 02:59:26,770 WARN [Listener at localhost/44793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-13 02:59:27,063 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf37201cd50bd66d3: Processing first storage report for DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183 from datanode 20c46451-7dd1-43df-94a7-0eb0576b4e87 2023-09-13 02:59:27,065 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf37201cd50bd66d3: from storage DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183 node DatanodeRegistration(127.0.0.1:43289, datanodeUuid=20c46451-7dd1-43df-94a7-0eb0576b4e87, infoPort=41357, infoSecurePort=0, ipcPort=35983, storageInfo=lv=-57;cid=testClusterID;nsid=1219970348;c=1694573964554), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-13 02:59:27,066 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd286b13b4318ca97: Processing first storage report for DS-3ec5c75d-f140-45e9-9724-618090610ee4 from datanode 5dd11235-bdba-4cc7-bc29-5950eb1a59f9 2023-09-13 02:59:27,066 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd286b13b4318ca97: from storage DS-3ec5c75d-f140-45e9-9724-618090610ee4 node DatanodeRegistration(127.0.0.1:43243, datanodeUuid=5dd11235-bdba-4cc7-bc29-5950eb1a59f9, infoPort=38659, infoSecurePort=0, ipcPort=44793, storageInfo=lv=-57;cid=testClusterID;nsid=1219970348;c=1694573964554), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 02:59:27,066 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b197a161b6f2540: Processing first storage report for DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465 from datanode 385448d5-8b44-4919-8761-a52d18a9428f 2023-09-13 02:59:27,066 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b197a161b6f2540: from storage DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465 node DatanodeRegistration(127.0.0.1:33943, datanodeUuid=385448d5-8b44-4919-8761-a52d18a9428f, infoPort=45591, infoSecurePort=0, ipcPort=41275, storageInfo=lv=-57;cid=testClusterID;nsid=1219970348;c=1694573964554), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 02:59:27,066 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf37201cd50bd66d3: Processing first storage report for DS-09d662ec-c4ca-41c9-942e-2878c83fd74a from datanode 20c46451-7dd1-43df-94a7-0eb0576b4e87 2023-09-13 02:59:27,067 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf37201cd50bd66d3: from storage DS-09d662ec-c4ca-41c9-942e-2878c83fd74a node DatanodeRegistration(127.0.0.1:43289, datanodeUuid=20c46451-7dd1-43df-94a7-0eb0576b4e87, infoPort=41357, infoSecurePort=0, ipcPort=35983, storageInfo=lv=-57;cid=testClusterID;nsid=1219970348;c=1694573964554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 02:59:27,078 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd286b13b4318ca97: Processing first storage report for DS-5db9270c-c2bf-4f44-ba39-4a38482e8c80 from datanode 5dd11235-bdba-4cc7-bc29-5950eb1a59f9 2023-09-13 02:59:27,078 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd286b13b4318ca97: from storage DS-5db9270c-c2bf-4f44-ba39-4a38482e8c80 node DatanodeRegistration(127.0.0.1:43243, datanodeUuid=5dd11235-bdba-4cc7-bc29-5950eb1a59f9, infoPort=38659, infoSecurePort=0, ipcPort=44793, storageInfo=lv=-57;cid=testClusterID;nsid=1219970348;c=1694573964554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 02:59:27,078 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7b197a161b6f2540: Processing first storage report for DS-68ca2232-60c7-4fb9-9377-b9becb6b3ba9 from datanode 385448d5-8b44-4919-8761-a52d18a9428f 2023-09-13 02:59:27,078 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7b197a161b6f2540: from storage DS-68ca2232-60c7-4fb9-9377-b9becb6b3ba9 node DatanodeRegistration(127.0.0.1:33943, datanodeUuid=385448d5-8b44-4919-8761-a52d18a9428f, infoPort=45591, infoSecurePort=0, ipcPort=41275, storageInfo=lv=-57;cid=testClusterID;nsid=1219970348;c=1694573964554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-13 02:59:27,277 DEBUG [Listener at localhost/44793] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd 2023-09-13 02:59:27,359 INFO [Listener at localhost/44793] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/zookeeper_0, clientPort=53387, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-13 02:59:27,376 INFO [Listener at localhost/44793] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53387 2023-09-13 02:59:27,384 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:27,385 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:28,049 INFO [Listener at localhost/44793] util.FSUtils(471): Created version file at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 with version=8 2023-09-13 02:59:28,049 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/hbase-staging 2023-09-13 02:59:28,395 INFO [Listener at localhost/44793] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-13 02:59:28,884 INFO [Listener at localhost/44793] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-09-13 02:59:28,916 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:28,916 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:28,917 INFO [Listener at localhost/44793] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 02:59:28,917 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:28,917 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 02:59:29,050 INFO [Listener at localhost/44793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 02:59:29,120 DEBUG [Listener at localhost/44793] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-13 02:59:29,208 INFO [Listener at localhost/44793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:34685 2023-09-13 02:59:29,221 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,223 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,246 INFO [Listener at localhost/44793] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34685 connecting to ZooKeeper ensemble=127.0.0.1:53387 2023-09-13 02:59:29,298 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:346850x0, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 02:59:29,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34685-0x100a32c2c440000 connected 2023-09-13 02:59:29,327 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 02:59:29,328 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 02:59:29,340 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 02:59:29,348 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34685 2023-09-13 02:59:29,348 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34685 2023-09-13 02:59:29,349 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34685 2023-09-13 02:59:29,349 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34685 2023-09-13 02:59:29,350 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34685 2023-09-13 02:59:29,356 INFO [Listener at localhost/44793] master.HMaster(444): hbase.rootdir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, hbase.cluster.distributed=false 2023-09-13 02:59:29,421 INFO [Listener at localhost/44793] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-13 02:59:29,421 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,421 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,422 INFO [Listener at localhost/44793] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 02:59:29,422 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,422 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 02:59:29,427 INFO [Listener at localhost/44793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 02:59:29,430 INFO [Listener at localhost/44793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35085 2023-09-13 02:59:29,433 INFO [Listener at localhost/44793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 02:59:29,440 INFO [Listener at localhost/44793] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 02:59:29,441 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,444 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,446 INFO [Listener at localhost/44793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35085 connecting to ZooKeeper ensemble=127.0.0.1:53387 2023-09-13 02:59:29,451 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:350850x0, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 02:59:29,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35085-0x100a32c2c440001 connected 2023-09-13 02:59:29,452 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 02:59:29,454 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 02:59:29,455 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 02:59:29,455 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35085 2023-09-13 02:59:29,456 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35085 2023-09-13 02:59:29,456 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35085 2023-09-13 02:59:29,456 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35085 2023-09-13 02:59:29,457 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35085 2023-09-13 02:59:29,469 INFO [Listener at localhost/44793] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-13 02:59:29,469 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,469 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,470 INFO [Listener at localhost/44793] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 02:59:29,470 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,470 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 02:59:29,470 INFO [Listener at localhost/44793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 02:59:29,477 INFO [Listener at localhost/44793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44723 2023-09-13 02:59:29,477 INFO [Listener at localhost/44793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 02:59:29,478 INFO [Listener at localhost/44793] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 02:59:29,479 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,482 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,485 INFO [Listener at localhost/44793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44723 connecting to ZooKeeper ensemble=127.0.0.1:53387 2023-09-13 02:59:29,489 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:447230x0, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 02:59:29,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44723-0x100a32c2c440002 connected 2023-09-13 02:59:29,490 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 02:59:29,491 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 02:59:29,492 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 02:59:29,493 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44723 2023-09-13 02:59:29,494 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44723 2023-09-13 02:59:29,494 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44723 2023-09-13 02:59:29,494 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44723 2023-09-13 02:59:29,495 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44723 2023-09-13 02:59:29,506 INFO [Listener at localhost/44793] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-09-13 02:59:29,506 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,506 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,507 INFO [Listener at localhost/44793] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-13 02:59:29,507 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-13 02:59:29,507 INFO [Listener at localhost/44793] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-13 02:59:29,507 INFO [Listener at localhost/44793] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-13 02:59:29,508 INFO [Listener at localhost/44793] ipc.NettyRpcServer(120): Bind to /172.31.2.10:45847 2023-09-13 02:59:29,509 INFO [Listener at localhost/44793] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-13 02:59:29,509 INFO [Listener at localhost/44793] mob.MobFileCache(124): MobFileCache disabled 2023-09-13 02:59:29,510 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,512 INFO [Listener at localhost/44793] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,513 INFO [Listener at localhost/44793] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45847 connecting to ZooKeeper ensemble=127.0.0.1:53387 2023-09-13 02:59:29,517 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:458470x0, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-13 02:59:29,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45847-0x100a32c2c440003 connected 2023-09-13 02:59:29,518 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 02:59:29,519 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 02:59:29,519 DEBUG [Listener at localhost/44793] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-13 02:59:29,520 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45847 2023-09-13 02:59:29,524 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45847 2023-09-13 02:59:29,524 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45847 2023-09-13 02:59:29,528 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45847 2023-09-13 02:59:29,529 DEBUG [Listener at localhost/44793] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45847 2023-09-13 02:59:29,530 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:29,539 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-13 02:59:29,541 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:29,560 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 02:59:29,560 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 02:59:29,560 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 02:59:29,560 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-13 02:59:29,560 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:29,561 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-13 02:59:29,563 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,34685,1694573968233 from backup master directory 2023-09-13 02:59:29,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-13 02:59:29,567 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:29,567 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-13 02:59:29,568 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 02:59:29,568 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:29,571 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-13 02:59:29,572 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-13 02:59:29,663 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/hbase.id with ID: cbf32719-6a7a-449c-a74b-ea4ff52a7cfa 2023-09-13 02:59:29,704 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-13 02:59:29,720 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:29,771 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x663bc032 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:29,803 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@594098a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:29,826 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-13 02:59:29,828 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-13 02:59:29,845 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-13 02:59:29,845 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-13 02:59:29,847 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-13 02:59:29,851 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-13 02:59:29,852 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 02:59:29,886 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store-tmp 2023-09-13 02:59:29,921 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:29,921 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-13 02:59:29,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 02:59:29,921 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 02:59:29,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-13 02:59:29,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 02:59:29,922 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 02:59:29,922 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 02:59:29,923 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/WALs/jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:29,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C34685%2C1694573968233, suffix=, logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/WALs/jenkins-hbase9.apache.org,34685,1694573968233, archiveDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/oldWALs, maxLogs=10 2023-09-13 02:59:30,001 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK] 2023-09-13 02:59:30,001 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK] 2023-09-13 02:59:30,001 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK] 2023-09-13 02:59:30,012 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-13 02:59:30,077 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/WALs/jenkins-hbase9.apache.org,34685,1694573968233/jenkins-hbase9.apache.org%2C34685%2C1694573968233.1694573969958 2023-09-13 02:59:30,077 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK], DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK], DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK]] 2023-09-13 02:59:30,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-13 02:59:30,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:30,081 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 02:59:30,082 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 02:59:30,143 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-13 02:59:30,149 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-13 02:59:30,182 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-13 02:59:30,194 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:30,199 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-13 02:59:30,201 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-13 02:59:30,214 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-13 02:59:30,218 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:30,218 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67500927, jitterRate=0.005842193961143494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:30,218 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 02:59:30,220 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-13 02:59:30,241 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-13 02:59:30,241 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-13 02:59:30,244 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-13 02:59:30,245 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 0 msec 2023-09-13 02:59:30,279 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 34 msec 2023-09-13 02:59:30,280 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-13 02:59:30,307 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-13 02:59:30,312 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-13 02:59:30,341 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-13 02:59:30,345 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-13 02:59:30,346 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-13 02:59:30,352 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-13 02:59:30,356 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-13 02:59:30,359 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:30,361 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-13 02:59:30,362 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-13 02:59:30,375 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-13 02:59:30,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 02:59:30,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 02:59:30,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 02:59:30,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-13 02:59:30,380 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:30,380 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,34685,1694573968233, sessionid=0x100a32c2c440000, setting cluster-up flag (Was=false) 2023-09-13 02:59:30,401 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:30,406 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-13 02:59:30,408 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:30,413 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:30,418 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-13 02:59:30,419 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:30,422 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp 2023-09-13 02:59:30,432 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(951): ClusterId : cbf32719-6a7a-449c-a74b-ea4ff52a7cfa 2023-09-13 02:59:30,432 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(951): ClusterId : cbf32719-6a7a-449c-a74b-ea4ff52a7cfa 2023-09-13 02:59:30,434 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(951): ClusterId : cbf32719-6a7a-449c-a74b-ea4ff52a7cfa 2023-09-13 02:59:30,440 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 02:59:30,440 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 02:59:30,440 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-13 02:59:30,448 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 02:59:30,448 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 02:59:30,448 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-13 02:59:30,448 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 02:59:30,448 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 02:59:30,448 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-13 02:59:30,452 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 02:59:30,453 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 02:59:30,453 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-13 02:59:30,456 DEBUG [RS:1;jenkins-hbase9:44723] zookeeper.ReadOnlyZKClient(139): Connect 0x3b31b604 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:30,457 DEBUG [RS:0;jenkins-hbase9:35085] zookeeper.ReadOnlyZKClient(139): Connect 0x1b95e206 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:30,457 DEBUG [RS:2;jenkins-hbase9:45847] zookeeper.ReadOnlyZKClient(139): Connect 0x38d23ecb to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:30,464 DEBUG [RS:1;jenkins-hbase9:44723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35f65f12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:30,464 DEBUG [RS:1;jenkins-hbase9:44723] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31c9dd74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-13 02:59:30,464 DEBUG [RS:2;jenkins-hbase9:45847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3615d7a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:30,465 DEBUG [RS:2;jenkins-hbase9:45847] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@322a55bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-13 02:59:30,504 DEBUG [RS:0;jenkins-hbase9:35085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15520f04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:30,505 DEBUG [RS:0;jenkins-hbase9:35085] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@116d8976, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-13 02:59:30,525 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:45847 2023-09-13 02:59:30,529 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:35085 2023-09-13 02:59:30,530 INFO [RS:2;jenkins-hbase9:45847] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 02:59:30,530 INFO [RS:0;jenkins-hbase9:35085] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 02:59:30,531 INFO [RS:2;jenkins-hbase9:45847] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 02:59:30,530 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:44723 2023-09-13 02:59:30,531 INFO [RS:0;jenkins-hbase9:35085] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 02:59:30,531 INFO [RS:1;jenkins-hbase9:44723] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-13 02:59:30,531 INFO [RS:1;jenkins-hbase9:44723] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-13 02:59:30,552 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-13 02:59:30,552 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 02:59:30,552 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 02:59:30,552 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-13 02:59:30,554 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:30,554 INFO [RS:2;jenkins-hbase9:45847] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:30,554 INFO [RS:0;jenkins-hbase9:35085] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:30,555 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 02:59:30,554 INFO [RS:1;jenkins-hbase9:44723] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:30,555 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-13 02:59:30,555 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 02:59:30,555 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1022): About to register with Master. 2023-09-13 02:59:30,558 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34685,1694573968233 with isa=jenkins-hbase9.apache.org/172.31.2.10:45847, startcode=1694573969506 2023-09-13 02:59:30,558 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34685,1694573968233 with isa=jenkins-hbase9.apache.org/172.31.2.10:44723, startcode=1694573969468 2023-09-13 02:59:30,558 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34685,1694573968233 with isa=jenkins-hbase9.apache.org/172.31.2.10:35085, startcode=1694573969420 2023-09-13 02:59:30,576 DEBUG [RS:1;jenkins-hbase9:44723] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 02:59:30,576 DEBUG [RS:0;jenkins-hbase9:35085] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 02:59:30,576 DEBUG [RS:2;jenkins-hbase9:45847] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-13 02:59:30,633 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33997, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 02:59:30,633 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35131, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 02:59:30,633 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54619, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-13 02:59:30,635 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-13 02:59:30,641 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34685] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-13 02:59:30,646 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,648 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694574000648 2023-09-13 02:59:30,649 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34685] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-13 02:59:30,651 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34685] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-13 02:59:30,653 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-13 02:59:30,658 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-13 02:59:30,659 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-13 02:59:30,663 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-13 02:59:30,664 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 02:59:30,669 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-13 02:59:30,669 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-13 02:59:30,670 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-13 02:59:30,670 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-13 02:59:30,670 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,672 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-13 02:59:30,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-13 02:59:30,674 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-13 02:59:30,674 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(2830): Master is not running yet 2023-09-13 02:59:30,674 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(2830): Master is not running yet 2023-09-13 02:59:30,675 WARN [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-13 02:59:30,674 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(2830): Master is not running yet 2023-09-13 02:59:30,675 WARN [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-13 02:59:30,675 WARN [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-13 02:59:30,677 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-13 02:59:30,677 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-13 02:59:30,679 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1694573970679,5,FailOnTimeoutGroup] 2023-09-13 02:59:30,680 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1694573970679,5,FailOnTimeoutGroup] 2023-09-13 02:59:30,680 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,680 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-13 02:59:30,681 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,682 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,704 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-13 02:59:30,705 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-13 02:59:30,706 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:30,728 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:30,730 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-13 02:59:30,732 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/info 2023-09-13 02:59:30,733 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-13 02:59:30,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:30,734 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-13 02:59:30,736 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/rep_barrier 2023-09-13 02:59:30,737 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-13 02:59:30,738 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:30,738 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-13 02:59:30,740 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/table 2023-09-13 02:59:30,741 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-13 02:59:30,741 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:30,743 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740 2023-09-13 02:59:30,744 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740 2023-09-13 02:59:30,747 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-13 02:59:30,749 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-13 02:59:30,753 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:30,753 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63083791, jitterRate=-0.05997826159000397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-13 02:59:30,753 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-13 02:59:30,754 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-13 02:59:30,754 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-13 02:59:30,754 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-13 02:59:30,754 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-13 02:59:30,754 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-13 02:59:30,755 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-13 02:59:30,755 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-13 02:59:30,761 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-13 02:59:30,761 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-13 02:59:30,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-13 02:59:30,776 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34685,1694573968233 with isa=jenkins-hbase9.apache.org/172.31.2.10:45847, startcode=1694573969506 2023-09-13 02:59:30,776 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34685,1694573968233 with isa=jenkins-hbase9.apache.org/172.31.2.10:44723, startcode=1694573969468 2023-09-13 02:59:30,776 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,34685,1694573968233 with isa=jenkins-hbase9.apache.org/172.31.2.10:35085, startcode=1694573969420 2023-09-13 02:59:30,782 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34685] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,785 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-13 02:59:30,790 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34685] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,790 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:30,791 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34433 2023-09-13 02:59:30,791 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 02:59:30,791 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34685] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,792 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-13 02:59:30,792 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:30,792 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:30,792 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34433 2023-09-13 02:59:30,792 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:34433 2023-09-13 02:59:30,793 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 02:59:30,793 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-13 02:59:30,797 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 02:59:30,803 DEBUG [RS:1;jenkins-hbase9:44723] zookeeper.ZKUtil(162): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,803 WARN [RS:1;jenkins-hbase9:44723] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 02:59:30,803 INFO [RS:1;jenkins-hbase9:44723] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 02:59:30,803 DEBUG [RS:2;jenkins-hbase9:45847] zookeeper.ZKUtil(162): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,803 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,803 DEBUG [RS:0;jenkins-hbase9:35085] zookeeper.ZKUtil(162): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,803 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44723,1694573969468] 2023-09-13 02:59:30,803 WARN [RS:2;jenkins-hbase9:45847] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 02:59:30,804 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,45847,1694573969506] 2023-09-13 02:59:30,804 INFO [RS:2;jenkins-hbase9:45847] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 02:59:30,804 WARN [RS:0;jenkins-hbase9:35085] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-13 02:59:30,804 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,804 INFO [RS:0;jenkins-hbase9:35085] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 02:59:30,805 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1948): logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,804 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35085,1694573969420] 2023-09-13 02:59:30,818 DEBUG [RS:0;jenkins-hbase9:35085] zookeeper.ZKUtil(162): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,818 DEBUG [RS:2;jenkins-hbase9:45847] zookeeper.ZKUtil(162): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,818 DEBUG [RS:1;jenkins-hbase9:44723] zookeeper.ZKUtil(162): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,818 DEBUG [RS:0;jenkins-hbase9:35085] zookeeper.ZKUtil(162): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,819 DEBUG [RS:2;jenkins-hbase9:45847] zookeeper.ZKUtil(162): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,819 DEBUG [RS:1;jenkins-hbase9:44723] zookeeper.ZKUtil(162): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,819 DEBUG [RS:0;jenkins-hbase9:35085] zookeeper.ZKUtil(162): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,819 DEBUG [RS:2;jenkins-hbase9:45847] zookeeper.ZKUtil(162): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,819 DEBUG [RS:1;jenkins-hbase9:44723] zookeeper.ZKUtil(162): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,831 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 02:59:30,831 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 02:59:30,831 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-13 02:59:30,841 INFO [RS:0;jenkins-hbase9:35085] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 02:59:30,841 INFO [RS:2;jenkins-hbase9:45847] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 02:59:30,841 INFO [RS:1;jenkins-hbase9:44723] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-13 02:59:30,863 INFO [RS:1;jenkins-hbase9:44723] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 02:59:30,863 INFO [RS:0;jenkins-hbase9:35085] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 02:59:30,863 INFO [RS:2;jenkins-hbase9:45847] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-13 02:59:30,868 INFO [RS:1;jenkins-hbase9:44723] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 02:59:30,868 INFO [RS:0;jenkins-hbase9:35085] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 02:59:30,869 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,868 INFO [RS:2;jenkins-hbase9:45847] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-13 02:59:30,869 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,869 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,870 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 02:59:30,870 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 02:59:30,870 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-13 02:59:30,879 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,879 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,879 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,879 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-13 02:59:30,880 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,880 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-13 02:59:30,880 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:0;jenkins-hbase9:35085] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,881 DEBUG [RS:2;jenkins-hbase9:45847] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,882 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,882 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-09-13 02:59:30,882 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,882 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,882 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,882 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,883 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,883 DEBUG [RS:1;jenkins-hbase9:44723] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-09-13 02:59:30,883 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,888 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,888 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,888 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,888 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,889 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,889 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,906 INFO [RS:0;jenkins-hbase9:35085] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 02:59:30,909 INFO [RS:2;jenkins-hbase9:45847] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 02:59:30,909 INFO [RS:1;jenkins-hbase9:44723] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-13 02:59:30,909 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,45847,1694573969506-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,910 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44723,1694573969468-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,909 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35085,1694573969420-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:30,930 INFO [RS:0;jenkins-hbase9:35085] regionserver.Replication(203): jenkins-hbase9.apache.org,35085,1694573969420 started 2023-09-13 02:59:30,931 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,35085,1694573969420, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35085, sessionid=0x100a32c2c440001 2023-09-13 02:59:30,931 INFO [RS:2;jenkins-hbase9:45847] regionserver.Replication(203): jenkins-hbase9.apache.org,45847,1694573969506 started 2023-09-13 02:59:30,931 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 02:59:30,931 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,45847,1694573969506, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:45847, sessionid=0x100a32c2c440003 2023-09-13 02:59:30,932 DEBUG [RS:0;jenkins-hbase9:35085] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,932 DEBUG [RS:0;jenkins-hbase9:35085] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35085,1694573969420' 2023-09-13 02:59:30,932 DEBUG [RS:0;jenkins-hbase9:35085] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 02:59:30,932 INFO [RS:1;jenkins-hbase9:44723] regionserver.Replication(203): jenkins-hbase9.apache.org,44723,1694573969468 started 2023-09-13 02:59:30,932 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 02:59:30,932 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,44723,1694573969468, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44723, sessionid=0x100a32c2c440002 2023-09-13 02:59:30,932 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-13 02:59:30,933 DEBUG [RS:1;jenkins-hbase9:44723] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,932 DEBUG [RS:2;jenkins-hbase9:45847] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,933 DEBUG [RS:0;jenkins-hbase9:35085] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 02:59:30,933 DEBUG [RS:1;jenkins-hbase9:44723] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44723,1694573969468' 2023-09-13 02:59:30,934 DEBUG [RS:1;jenkins-hbase9:44723] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 02:59:30,934 DEBUG [RS:2;jenkins-hbase9:45847] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45847,1694573969506' 2023-09-13 02:59:30,934 DEBUG [RS:2;jenkins-hbase9:45847] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-13 02:59:30,934 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 02:59:30,934 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 02:59:30,935 DEBUG [RS:0;jenkins-hbase9:35085] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:30,935 DEBUG [RS:0;jenkins-hbase9:35085] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35085,1694573969420' 2023-09-13 02:59:30,935 DEBUG [RS:0;jenkins-hbase9:35085] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:30,935 DEBUG [RS:1;jenkins-hbase9:44723] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 02:59:30,935 DEBUG [RS:2;jenkins-hbase9:45847] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-13 02:59:30,935 DEBUG [RS:0;jenkins-hbase9:35085] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:30,936 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 02:59:30,936 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 02:59:30,936 DEBUG [RS:1;jenkins-hbase9:44723] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:30,936 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-13 02:59:30,936 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-13 02:59:30,937 DEBUG [RS:2;jenkins-hbase9:45847] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:30,937 DEBUG [RS:2;jenkins-hbase9:45847] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,45847,1694573969506' 2023-09-13 02:59:30,937 DEBUG [RS:2;jenkins-hbase9:45847] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:30,937 DEBUG [RS:0;jenkins-hbase9:35085] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 02:59:30,937 INFO [RS:0;jenkins-hbase9:35085] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 02:59:30,936 DEBUG [RS:1;jenkins-hbase9:44723] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44723,1694573969468' 2023-09-13 02:59:30,937 DEBUG [RS:1;jenkins-hbase9:44723] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:30,937 INFO [RS:0;jenkins-hbase9:35085] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 02:59:30,937 DEBUG [RS:2;jenkins-hbase9:45847] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:30,938 DEBUG [RS:2;jenkins-hbase9:45847] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 02:59:30,938 DEBUG [RS:1;jenkins-hbase9:44723] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:30,938 INFO [RS:2;jenkins-hbase9:45847] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 02:59:30,938 INFO [RS:2;jenkins-hbase9:45847] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 02:59:30,940 DEBUG [RS:1;jenkins-hbase9:44723] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-13 02:59:30,940 INFO [RS:1;jenkins-hbase9:44723] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-13 02:59:30,940 INFO [RS:1;jenkins-hbase9:44723] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-13 02:59:30,944 DEBUG [jenkins-hbase9:34685] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-13 02:59:30,949 DEBUG [jenkins-hbase9:34685] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 02:59:30,954 DEBUG [jenkins-hbase9:34685] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 02:59:30,954 DEBUG [jenkins-hbase9:34685] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 02:59:30,954 DEBUG [jenkins-hbase9:34685] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 02:59:30,954 DEBUG [jenkins-hbase9:34685] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 02:59:30,957 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,44723,1694573969468, state=OPENING 2023-09-13 02:59:30,964 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-13 02:59:30,965 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:30,966 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-13 02:59:30,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 02:59:31,048 INFO [RS:0;jenkins-hbase9:35085] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35085%2C1694573969420, suffix=, logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,35085,1694573969420, archiveDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs, maxLogs=32 2023-09-13 02:59:31,048 INFO [RS:2;jenkins-hbase9:45847] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C45847%2C1694573969506, suffix=, logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,45847,1694573969506, archiveDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs, maxLogs=32 2023-09-13 02:59:31,048 INFO [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44723%2C1694573969468, suffix=, logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,44723,1694573969468, archiveDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs, maxLogs=32 2023-09-13 02:59:31,085 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK] 2023-09-13 02:59:31,085 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK] 2023-09-13 02:59:31,085 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK] 2023-09-13 02:59:31,085 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK] 2023-09-13 02:59:31,089 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK] 2023-09-13 02:59:31,089 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK] 2023-09-13 02:59:31,089 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK] 2023-09-13 02:59:31,089 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK] 2023-09-13 02:59:31,090 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK] 2023-09-13 02:59:31,101 INFO [RS:0;jenkins-hbase9:35085] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,35085,1694573969420/jenkins-hbase9.apache.org%2C35085%2C1694573969420.1694573971053 2023-09-13 02:59:31,109 DEBUG [RS:0;jenkins-hbase9:35085] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK], DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK], DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK]] 2023-09-13 02:59:31,109 INFO [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,44723,1694573969468/jenkins-hbase9.apache.org%2C44723%2C1694573969468.1694573971053 2023-09-13 02:59:31,109 INFO [RS:2;jenkins-hbase9:45847] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,45847,1694573969506/jenkins-hbase9.apache.org%2C45847%2C1694573969506.1694573971053 2023-09-13 02:59:31,112 DEBUG [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK], DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK], DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK]] 2023-09-13 02:59:31,112 DEBUG [RS:2;jenkins-hbase9:45847] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK], DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK], DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK]] 2023-09-13 02:59:31,153 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:31,156 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 02:59:31,159 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 02:59:31,172 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-13 02:59:31,172 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-13 02:59:31,175 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44723%2C1694573969468.meta, suffix=.meta, logDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,44723,1694573969468, archiveDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs, maxLogs=32 2023-09-13 02:59:31,193 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK] 2023-09-13 02:59:31,194 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK] 2023-09-13 02:59:31,194 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK] 2023-09-13 02:59:31,201 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/WALs/jenkins-hbase9.apache.org,44723,1694573969468/jenkins-hbase9.apache.org%2C44723%2C1694573969468.meta.1694573971176.meta 2023-09-13 02:59:31,202 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33943,DS-1a7bfaf1-624c-4fff-801b-6db13a5ab465,DISK], DatanodeInfoWithStorage[127.0.0.1:43243,DS-3ec5c75d-f140-45e9-9724-618090610ee4,DISK], DatanodeInfoWithStorage[127.0.0.1:43289,DS-8e13ca3b-a23e-449c-9e25-fd8ac1ebf183,DISK]] 2023-09-13 02:59:31,202 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-13 02:59:31,203 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-13 02:59:31,205 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:31,205 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-13 02:59:31,207 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-13 02:59:31,209 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-13 02:59:31,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-13 02:59:31,222 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:31,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-13 02:59:31,223 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-13 02:59:31,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-13 02:59:31,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/info 2023-09-13 02:59:31,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/info 2023-09-13 02:59:31,228 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-13 02:59:31,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:31,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-13 02:59:31,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/rep_barrier 2023-09-13 02:59:31,233 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/rep_barrier 2023-09-13 02:59:31,234 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-13 02:59:31,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:31,235 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-13 02:59:31,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/table 2023-09-13 02:59:31,237 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/table 2023-09-13 02:59:31,238 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-13 02:59:31,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:31,240 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740 2023-09-13 02:59:31,243 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740 2023-09-13 02:59:31,246 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-13 02:59:31,249 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-13 02:59:31,250 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71295677, jitterRate=0.06238837540149689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-13 02:59:31,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-13 02:59:31,262 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694573971146 2023-09-13 02:59:31,279 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-13 02:59:31,280 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-13 02:59:31,280 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,44723,1694573969468, state=OPEN 2023-09-13 02:59:31,283 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-13 02:59:31,284 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-13 02:59:31,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-13 02:59:31,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,44723,1694573969468 in 314 msec 2023-09-13 02:59:31,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-13 02:59:31,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 519 msec 2023-09-13 02:59:31,301 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 736 msec 2023-09-13 02:59:31,301 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694573971301, completionTime=-1 2023-09-13 02:59:31,301 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-13 02:59:31,301 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-13 02:59:31,383 DEBUG [hconnection-0x69dc80a9-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:31,386 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:31,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-13 02:59:31,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694574031407 2023-09-13 02:59:31,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694574091407 2023-09-13 02:59:31,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 106 msec 2023-09-13 02:59:31,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34685,1694573968233-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:31,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34685,1694573968233-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:31,431 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34685,1694573968233-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:31,433 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:34685, period=300000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:31,433 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-13 02:59:31,443 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-13 02:59:31,486 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-13 02:59:31,489 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 02:59:31,499 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-13 02:59:31,501 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 02:59:31,504 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 02:59:31,525 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/namespace/52690797349158d4b188dff423435b38 2023-09-13 02:59:31,527 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/namespace/52690797349158d4b188dff423435b38 empty. 2023-09-13 02:59:31,528 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/namespace/52690797349158d4b188dff423435b38 2023-09-13 02:59:31,528 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-13 02:59:31,566 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-13 02:59:31,567 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 52690797349158d4b188dff423435b38, NAME => 'hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 02:59:31,588 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:31,588 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 52690797349158d4b188dff423435b38, disabling compactions & flushes 2023-09-13 02:59:31,588 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:31,588 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:31,588 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. after waiting 0 ms 2023-09-13 02:59:31,588 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:31,588 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:31,588 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 52690797349158d4b188dff423435b38: 2023-09-13 02:59:31,593 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 02:59:31,607 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694573971596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573971596"}]},"ts":"1694573971596"} 2023-09-13 02:59:31,632 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-13 02:59:31,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 02:59:31,638 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573971634"}]},"ts":"1694573971634"} 2023-09-13 02:59:31,641 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-13 02:59:31,646 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 02:59:31,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 02:59:31,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 02:59:31,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 02:59:31,648 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 02:59:31,650 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52690797349158d4b188dff423435b38, ASSIGN}] 2023-09-13 02:59:31,653 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=52690797349158d4b188dff423435b38, ASSIGN 2023-09-13 02:59:31,655 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=52690797349158d4b188dff423435b38, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 02:59:31,807 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 02:59:31,808 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52690797349158d4b188dff423435b38, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:31,808 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694573971808"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573971808"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573971808"}]},"ts":"1694573971808"} 2023-09-13 02:59:31,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 52690797349158d4b188dff423435b38, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 02:59:31,968 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:31,968 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 02:59:31,971 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 02:59:31,976 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:31,976 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 52690797349158d4b188dff423435b38, NAME => 'hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.', STARTKEY => '', ENDKEY => ''} 2023-09-13 02:59:31,977 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. service=AccessControlService 2023-09-13 02:59:31,977 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:31,978 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 52690797349158d4b188dff423435b38 2023-09-13 02:59:31,978 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:31,978 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 52690797349158d4b188dff423435b38 2023-09-13 02:59:31,978 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 52690797349158d4b188dff423435b38 2023-09-13 02:59:31,980 INFO [StoreOpener-52690797349158d4b188dff423435b38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 52690797349158d4b188dff423435b38 2023-09-13 02:59:31,982 DEBUG [StoreOpener-52690797349158d4b188dff423435b38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/info 2023-09-13 02:59:31,982 DEBUG [StoreOpener-52690797349158d4b188dff423435b38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/info 2023-09-13 02:59:31,983 INFO [StoreOpener-52690797349158d4b188dff423435b38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 52690797349158d4b188dff423435b38 columnFamilyName info 2023-09-13 02:59:31,983 INFO [StoreOpener-52690797349158d4b188dff423435b38-1] regionserver.HStore(310): Store=52690797349158d4b188dff423435b38/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:31,985 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38 2023-09-13 02:59:31,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38 2023-09-13 02:59:31,990 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 52690797349158d4b188dff423435b38 2023-09-13 02:59:31,993 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:31,994 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 52690797349158d4b188dff423435b38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61401875, jitterRate=-0.08504076302051544}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:31,994 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 52690797349158d4b188dff423435b38: 2023-09-13 02:59:31,997 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38., pid=6, masterSystemTime=1694573971968 2023-09-13 02:59:32,002 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:32,002 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 02:59:32,004 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=52690797349158d4b188dff423435b38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:32,004 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694573972003"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694573972003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694573972003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694573972003"}]},"ts":"1694573972003"} 2023-09-13 02:59:32,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-13 02:59:32,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 52690797349158d4b188dff423435b38, server=jenkins-hbase9.apache.org,45847,1694573969506 in 194 msec 2023-09-13 02:59:32,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-13 02:59:32,017 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=52690797349158d4b188dff423435b38, ASSIGN in 362 msec 2023-09-13 02:59:32,018 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 02:59:32,018 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573972018"}]},"ts":"1694573972018"} 2023-09-13 02:59:32,020 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-13 02:59:32,025 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 02:59:32,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 535 msec 2023-09-13 02:59:32,102 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-13 02:59:32,103 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-13 02:59:32,103 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:32,125 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:32,127 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:32,143 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-13 02:59:32,157 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-13 02:59:32,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-09-13 02:59:32,166 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-13 02:59:32,177 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-13 02:59:32,182 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-09-13 02:59:32,191 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-13 02:59:32,195 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-13 02:59:32,195 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.627sec 2023-09-13 02:59:32,199 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-13 02:59:32,200 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-13 02:59:32,200 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-13 02:59:32,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34685,1694573968233-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-13 02:59:32,202 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,34685,1694573968233-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-13 02:59:32,221 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-13 02:59:32,223 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-13 02:59:32,225 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 02:59:32,227 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 02:59:32,229 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-13 02:59:32,230 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,231 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d empty. 2023-09-13 02:59:32,233 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,233 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-13 02:59:32,237 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 02:59:32,239 DEBUG [Listener at localhost/44793] zookeeper.ReadOnlyZKClient(139): Connect 0x627146cd to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:32,244 DEBUG [Listener at localhost/44793] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cba4ac7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:32,263 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-13 02:59:32,264 DEBUG [hconnection-0x1eb93e1b-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:32,265 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => f28d2870f42268ba9884db2abddbf11d, NAME => 'hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 02:59:32,275 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:32,278 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 02:59:32,281 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-13 02:59:32,283 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/test.cache.data in system properties and HBase conf 2023-09-13 02:59:32,283 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop.tmp.dir in system properties and HBase conf 2023-09-13 02:59:32,283 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop.log.dir in system properties and HBase conf 2023-09-13 02:59:32,283 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-13 02:59:32,283 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-13 02:59:32,284 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-13 02:59:32,284 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-13 02:59:32,284 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-13 02:59:32,284 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-13 02:59:32,285 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 02:59:32,285 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-13 02:59:32,285 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-13 02:59:32,286 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-13 02:59:32,286 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 02:59:32,286 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-13 02:59:32,287 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/nfs.dump.dir in system properties and HBase conf 2023-09-13 02:59:32,287 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir in system properties and HBase conf 2023-09-13 02:59:32,287 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-13 02:59:32,288 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-13 02:59:32,288 INFO [Listener at localhost/44793] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-13 02:59:32,289 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:32,289 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing f28d2870f42268ba9884db2abddbf11d, disabling compactions & flushes 2023-09-13 02:59:32,289 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,289 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,289 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. after waiting 0 ms 2023-09-13 02:59:32,289 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,289 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,289 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for f28d2870f42268ba9884db2abddbf11d: 2023-09-13 02:59:32,293 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 02:59:32,295 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694573972294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573972294"}]},"ts":"1694573972294"} 2023-09-13 02:59:32,297 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-13 02:59:32,299 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 02:59:32,299 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573972299"}]},"ts":"1694573972299"} 2023-09-13 02:59:32,301 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-13 02:59:32,307 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 02:59:32,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 02:59:32,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 02:59:32,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 02:59:32,308 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 02:59:32,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f28d2870f42268ba9884db2abddbf11d, ASSIGN}] 2023-09-13 02:59:32,313 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=f28d2870f42268ba9884db2abddbf11d, ASSIGN 2023-09-13 02:59:32,314 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=f28d2870f42268ba9884db2abddbf11d, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35085,1694573969420; forceNewPlan=false, retain=false 2023-09-13 02:59:32,342 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 02:59:32,465 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 02:59:32,467 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f28d2870f42268ba9884db2abddbf11d, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:32,467 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694573972466"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573972466"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573972466"}]},"ts":"1694573972466"} 2023-09-13 02:59:32,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure f28d2870f42268ba9884db2abddbf11d, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 02:59:32,543 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 02:59:32,625 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:32,626 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 02:59:32,629 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 02:59:32,635 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f28d2870f42268ba9884db2abddbf11d, NAME => 'hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.', STARTKEY => '', ENDKEY => ''} 2023-09-13 02:59:32,636 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. service=AccessControlService 2023-09-13 02:59:32,636 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:32,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:32,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,639 INFO [StoreOpener-f28d2870f42268ba9884db2abddbf11d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,642 DEBUG [StoreOpener-f28d2870f42268ba9884db2abddbf11d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/l 2023-09-13 02:59:32,642 DEBUG [StoreOpener-f28d2870f42268ba9884db2abddbf11d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/l 2023-09-13 02:59:32,642 INFO [StoreOpener-f28d2870f42268ba9884db2abddbf11d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f28d2870f42268ba9884db2abddbf11d columnFamilyName l 2023-09-13 02:59:32,643 INFO [StoreOpener-f28d2870f42268ba9884db2abddbf11d-1] regionserver.HStore(310): Store=f28d2870f42268ba9884db2abddbf11d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:32,645 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,646 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,651 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f28d2870f42268ba9884db2abddbf11d 2023-09-13 02:59:32,655 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:32,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f28d2870f42268ba9884db2abddbf11d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66309382, jitterRate=-0.011913210153579712}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:32,656 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f28d2870f42268ba9884db2abddbf11d: 2023-09-13 02:59:32,659 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d., pid=11, masterSystemTime=1694573972625 2023-09-13 02:59:32,664 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,664 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 02:59:32,665 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=f28d2870f42268ba9884db2abddbf11d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:32,665 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694573972665"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694573972665"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694573972665"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694573972665"}]},"ts":"1694573972665"} 2023-09-13 02:59:32,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-13 02:59:32,671 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure f28d2870f42268ba9884db2abddbf11d, server=jenkins-hbase9.apache.org,35085,1694573969420 in 198 msec 2023-09-13 02:59:32,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-13 02:59:32,675 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=f28d2870f42268ba9884db2abddbf11d, ASSIGN in 363 msec 2023-09-13 02:59:32,676 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 02:59:32,676 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573972676"}]},"ts":"1694573972676"} 2023-09-13 02:59:32,678 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-13 02:59:32,681 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 02:59:32,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 459 msec 2023-09-13 02:59:32,843 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-13 02:59:32,843 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-13 02:59:32,854 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-13 02:59:33,414 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:33,756 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:33,764 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_43053_jobhistory____cd50z7/webapp 2023-09-13 02:59:33,958 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-13 02:59:33,958 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-13 02:59:33,958 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 02:59:33,961 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 02:59:34,049 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:34,378 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:34,652 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-13 02:59:34,680 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:43053 2023-09-13 02:59:34,911 WARN [Listener at jenkins-hbase9.apache.org/41353] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:35,163 WARN [Listener at jenkins-hbase9.apache.org/41353] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 02:59:35,164 INFO [Listener at jenkins-hbase9.apache.org/41353] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:35,173 INFO [Listener at jenkins-hbase9.apache.org/41353] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_45219_cluster____4e71zk/webapp 2023-09-13 02:59:35,251 INFO [Listener at jenkins-hbase9.apache.org/41353] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 02:59:35,252 INFO [Listener at jenkins-hbase9.apache.org/41353] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-13 02:59:35,252 INFO [Listener at jenkins-hbase9.apache.org/41353] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 02:59:35,252 INFO [Listener at jenkins-hbase9.apache.org/41353] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 02:59:35,260 INFO [Listener at jenkins-hbase9.apache.org/41353] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:35,443 INFO [Listener at jenkins-hbase9.apache.org/41353] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:35,568 INFO [Listener at jenkins-hbase9.apache.org/41353] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:35,578 INFO [Listener at jenkins-hbase9.apache.org/41353] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:45219 2023-09-13 02:59:36,035 WARN [Listener at jenkins-hbase9.apache.org/44685] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:36,060 WARN [Listener at jenkins-hbase9.apache.org/44685] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 02:59:36,061 INFO [Listener at jenkins-hbase9.apache.org/44685] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:36,067 INFO [Listener at jenkins-hbase9.apache.org/44685] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46237_node____.34879v/webapp 2023-09-13 02:59:36,118 INFO [Listener at jenkins-hbase9.apache.org/44685] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-13 02:59:36,118 INFO [Listener at jenkins-hbase9.apache.org/44685] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 02:59:36,118 INFO [Listener at jenkins-hbase9.apache.org/44685] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 02:59:36,118 INFO [Listener at jenkins-hbase9.apache.org/44685] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 02:59:36,128 INFO [Listener at jenkins-hbase9.apache.org/44685] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:36,150 INFO [Listener at jenkins-hbase9.apache.org/44685] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:36,217 INFO [Listener at jenkins-hbase9.apache.org/44685] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:36,230 INFO [Listener at jenkins-hbase9.apache.org/44685] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46237 2023-09-13 02:59:36,408 WARN [Listener at jenkins-hbase9.apache.org/41229] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-13 02:59:36,414 WARN [Listener at jenkins-hbase9.apache.org/41229] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-13 02:59:36,414 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): jetty-6.1.26 2023-09-13 02:59:36,422 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_43333_node____9aourx/webapp 2023-09-13 02:59:36,472 INFO [Listener at jenkins-hbase9.apache.org/41229] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-13 02:59:36,473 INFO [Listener at jenkins-hbase9.apache.org/41229] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-13 02:59:36,473 INFO [Listener at jenkins-hbase9.apache.org/41229] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-13 02:59:36,473 INFO [Listener at jenkins-hbase9.apache.org/41229] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-13 02:59:36,482 INFO [Listener at jenkins-hbase9.apache.org/41229] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:36,496 INFO [Listener at jenkins-hbase9.apache.org/41229] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:36,553 INFO [Listener at jenkins-hbase9.apache.org/41229] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-13 02:59:36,557 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:43333 2023-09-13 02:59:36,579 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-13 02:59:36,581 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 02:59:36,635 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=87, ProcessCount=164, AvailableMemoryMB=6922 2023-09-13 02:59:36,635 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-09-13 02:59:36,651 DEBUG [Listener at jenkins-hbase9.apache.org/41229] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-13 02:59:36,656 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-13 02:59:36,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 02:59:36,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:36,667 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 02:59:36,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-13 02:59:36,669 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 02:59:36,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 02:59:36,674 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:36,674 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:36,675 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 empty. 2023-09-13 02:59:36,676 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae empty. 2023-09-13 02:59:36,676 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:36,677 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:36,677 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-13 02:59:36,707 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-13 02:59:36,708 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f37ba64e579fe266cce22e692d70eae, NAME => 'testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 02:59:36,708 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3c25c9d910a9a54d7d91c2a3d1e078c6, NAME => 'testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 02:59:36,744 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:36,744 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 3c25c9d910a9a54d7d91c2a3d1e078c6, disabling compactions & flushes 2023-09-13 02:59:36,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:36,745 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:36,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 3f37ba64e579fe266cce22e692d70eae, disabling compactions & flushes 2023-09-13 02:59:36,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:36,745 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. after waiting 0 ms 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. after waiting 0 ms 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:36,746 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:36,746 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 3c25c9d910a9a54d7d91c2a3d1e078c6: 2023-09-13 02:59:36,746 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 3f37ba64e579fe266cce22e692d70eae: 2023-09-13 02:59:36,750 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 02:59:36,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573976751"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573976751"}]},"ts":"1694573976751"} 2023-09-13 02:59:36,752 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573976751"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573976751"}]},"ts":"1694573976751"} 2023-09-13 02:59:36,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 02:59:36,773 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 02:59:36,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 02:59:36,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 02:59:36,834 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573976833"}]},"ts":"1694573976833"} 2023-09-13 02:59:36,842 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-13 02:59:36,847 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 02:59:36,849 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 02:59:36,849 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 02:59:36,849 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 02:59:36,849 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 02:59:36,849 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, ASSIGN}] 2023-09-13 02:59:36,852 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, ASSIGN 2023-09-13 02:59:36,852 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, ASSIGN 2023-09-13 02:59:36,853 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 02:59:36,854 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35085,1694573969420; forceNewPlan=false, retain=false 2023-09-13 02:59:36,912 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-13 02:59:36,914 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-13 02:59:36,915 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-13 02:59:36,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 02:59:37,004 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 02:59:37,007 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3c25c9d910a9a54d7d91c2a3d1e078c6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,007 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3f37ba64e579fe266cce22e692d70eae, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,007 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573977007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573977007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573977007"}]},"ts":"1694573977007"} 2023-09-13 02:59:37,007 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573977007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573977007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573977007"}]},"ts":"1694573977007"} 2023-09-13 02:59:37,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 3c25c9d910a9a54d7d91c2a3d1e078c6, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 02:59:37,011 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 3f37ba64e579fe266cce22e692d70eae, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 02:59:37,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3c25c9d910a9a54d7d91c2a3d1e078c6, NAME => 'testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 02:59:37,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f37ba64e579fe266cce22e692d70eae, NAME => 'testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 02:59:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. service=AccessControlService 2023-09-13 02:59:37,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. service=AccessControlService 2023-09-13 02:59:37,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:37,173 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,173 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,176 INFO [StoreOpener-3c25c9d910a9a54d7d91c2a3d1e078c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,176 INFO [StoreOpener-3f37ba64e579fe266cce22e692d70eae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,178 DEBUG [StoreOpener-3c25c9d910a9a54d7d91c2a3d1e078c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf 2023-09-13 02:59:37,178 DEBUG [StoreOpener-3c25c9d910a9a54d7d91c2a3d1e078c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf 2023-09-13 02:59:37,179 DEBUG [StoreOpener-3f37ba64e579fe266cce22e692d70eae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf 2023-09-13 02:59:37,179 DEBUG [StoreOpener-3f37ba64e579fe266cce22e692d70eae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf 2023-09-13 02:59:37,182 INFO [StoreOpener-3c25c9d910a9a54d7d91c2a3d1e078c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c25c9d910a9a54d7d91c2a3d1e078c6 columnFamilyName cf 2023-09-13 02:59:37,182 INFO [StoreOpener-3f37ba64e579fe266cce22e692d70eae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f37ba64e579fe266cce22e692d70eae columnFamilyName cf 2023-09-13 02:59:37,184 INFO [StoreOpener-3c25c9d910a9a54d7d91c2a3d1e078c6-1] regionserver.HStore(310): Store=3c25c9d910a9a54d7d91c2a3d1e078c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:37,185 INFO [StoreOpener-3f37ba64e579fe266cce22e692d70eae-1] regionserver.HStore(310): Store=3f37ba64e579fe266cce22e692d70eae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:37,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:37,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:37,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:37,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:37,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3f37ba64e579fe266cce22e692d70eae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67102203, jitterRate=-9.925663471221924E-5}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:37,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3f37ba64e579fe266cce22e692d70eae: 2023-09-13 02:59:37,204 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3c25c9d910a9a54d7d91c2a3d1e078c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59750027, jitterRate=-0.1096552163362503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:37,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3c25c9d910a9a54d7d91c2a3d1e078c6: 2023-09-13 02:59:37,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae., pid=16, masterSystemTime=1694573977164 2023-09-13 02:59:37,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6., pid=15, masterSystemTime=1694573977163 2023-09-13 02:59:37,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:37,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:37,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3f37ba64e579fe266cce22e692d70eae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:37,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:37,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573977209"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694573977209"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694573977209"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694573977209"}]},"ts":"1694573977209"} 2023-09-13 02:59:37,211 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3c25c9d910a9a54d7d91c2a3d1e078c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,212 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573977211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694573977211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694573977211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694573977211"}]},"ts":"1694573977211"} 2023-09-13 02:59:37,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-13 02:59:37,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 3f37ba64e579fe266cce22e692d70eae, server=jenkins-hbase9.apache.org,35085,1694573969420 in 202 msec 2023-09-13 02:59:37,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-13 02:59:37,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 3c25c9d910a9a54d7d91c2a3d1e078c6, server=jenkins-hbase9.apache.org,45847,1694573969506 in 205 msec 2023-09-13 02:59:37,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, ASSIGN in 371 msec 2023-09-13 02:59:37,225 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=12 2023-09-13 02:59:37,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, ASSIGN in 373 msec 2023-09-13 02:59:37,227 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 02:59:37,227 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573977227"}]},"ts":"1694573977227"} 2023-09-13 02:59:37,229 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-13 02:59:37,233 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 02:59:37,238 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-13 02:59:37,243 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,246 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,250 DEBUG [hconnection-0x1fd8387e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,252 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,260 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 02:59:37,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 02:59:37,291 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:37,291 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:37,291 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 02:59:37,291 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:37,291 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:37,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:37,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:37,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:37,300 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:37,303 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 638 msec 2023-09-13 02:59:37,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-13 02:59:37,777 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-13 02:59:37,781 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-13 02:59:37,782 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:37,785 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 02:59:37,806 DEBUG [hconnection-0x1eb93e1b-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,809 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,812 DEBUG [hconnection-0x1eb93e1b-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,816 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 02:59:37,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694573977831 (current time:1694573977831). 2023-09-13 02:59:37,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 02:59:37,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x2cbcd5c1 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:37,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13aee0d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:37,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,842 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43950, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cbcd5c1 to 127.0.0.1:53387 2023-09-13 02:59:37,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:37,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x7404e59f to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:37,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ea651de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:37,853 DEBUG [hconnection-0x4330a2cb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,853 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:37,859 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7404e59f to 127.0.0.1:53387 2023-09-13 02:59:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 02:59:37,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 02:59:37,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 02:59:37,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 02:59:37,902 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 02:59:37,904 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694574577904 2023-09-13 02:59:37,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 02:59:37,904 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-13 02:59:37,907 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 02:59:37,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 02:59:37,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-13 02:59:37,910 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 02:59:37,911 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694574577911 2023-09-13 02:59:37,911 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 02:59:37,911 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 02:59:37,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,939 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-13 02:59:37,940 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:37,940 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-13 02:59:37,940 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-13 02:59:37,941 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,941 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,951 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:37,951 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:37,951 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:37,951 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:37,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:37,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:37,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:37,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:37,952 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:37,952 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,953 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,954 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 02:59:37,954 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-13 02:59:37,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 02:59:37,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 02:59:37,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 02:59:37,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,958 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,958 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 02:59:37,958 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 02:59:37,958 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 02:59:37,958 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:37,958 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:37,958 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:37,959 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 02:59:37,960 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 02:59:37,959 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 02:59:37,960 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 02:59:37,960 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 02:59:37,960 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 02:59:37,960 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 02:59:37,960 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-13 02:59:37,961 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-13 02:59:37,963 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,963 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:37,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:37,964 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,964 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:37,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:37,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:37,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-13 02:59:37,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1871d226[Count = 1] remaining members to acquire global barrier 2023-09-13 02:59:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:37,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:37,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:37,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-13 02:59:37,970 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1871d226[Count = 0] remaining members to acquire global barrier 2023-09-13 02:59:37,970 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-13 02:59:37,970 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 02:59:37,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,972 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 02:59:37,973 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:37,973 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:37,973 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:37,973 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:37,973 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:37,974 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. started... 2023-09-13 02:59:37,974 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. started... 2023-09-13 02:59:37,977 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 02:59:37,977 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:37,977 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 02:59:37,979 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c25c9d910a9a54d7d91c2a3d1e078c6: 2023-09-13 02:59:37,979 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f37ba64e579fe266cce22e692d70eae: 2023-09-13 02:59:37,980 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,980 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:37,985 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:37,985 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:37,988 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 02:59:37,988 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 02:59:38,011 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:38,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 02:59:38,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 02:59:38,024 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 02:59:38,024 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. completed. 2023-09-13 02:59:38,024 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:38,025 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. completed. 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,025 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-13 02:59:38,025 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 02:59:38,027 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,027 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,027 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 02:59:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,027 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,027 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 02:59:38,027 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 02:59:38,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,027 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,028 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-13 02:59:38,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35085,1694573969420': 2023-09-13 02:59:38,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-13 02:59:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 02:59:38,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-13 02:59:38,038 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-13 02:59:38,038 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 02:59:38,038 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 02:59:38,038 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,038 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 02:59:38,041 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,041 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,041 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,042 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,041 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,042 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,043 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,043 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,047 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,047 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,047 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,060 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,060 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,061 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,062 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 02:59:38,060 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,061 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,062 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,062 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,062 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 02:59:38,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,140 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-13 02:59:38,140 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,141 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:38,141 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694573977904Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694573978080 (+176 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694573978080Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694573978080Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694573978097 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694573978128 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694573978140 (+12 ms) 2023-09-13 02:59:38,143 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 02:59:38,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 238 msec 2023-09-13 02:59:38,224 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:38,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 02:59:38,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 02:59:38,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35085] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 02:59:38,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 02:59:38,249 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-13 02:59:38,249 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:38,250 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 02:59:38,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 02:59:38,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694573978265 (current time:1694573978265). 2023-09-13 02:59:38,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 02:59:38,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x26c6aa1e to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:38,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b4fd3f9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:38,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:38,282 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26c6aa1e to 127.0.0.1:53387 2023-09-13 02:59:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:38,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x250f25fe to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:38,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@368afd1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:38,291 DEBUG [hconnection-0x53bf2028-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:38,293 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:38,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:38,298 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:38,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x250f25fe to 127.0.0.1:53387 2023-09-13 02:59:38,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:38,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-13 02:59:38,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 02:59:38,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 02:59:38,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 02:59:38,304 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 02:59:38,305 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694574578305 2023-09-13 02:59:38,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-13 02:59:38,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-13 02:59:38,307 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 02:59:38,307 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 02:59:38,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 02:59:38,308 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-13 02:59:38,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-09-13 02:59:38,311 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 02:59:38,311 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694574578311 2023-09-13 02:59:38,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-13 02:59:38,327 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-13 02:59:38,327 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:38,328 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-13 02:59:38,328 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-13 02:59:38,329 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,329 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,331 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,331 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,331 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,332 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,332 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 02:59:38,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 02:59:38,333 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 02:59:38,333 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 02:59:38,333 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-13 02:59:38,336 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:38,336 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:38,337 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 02:59:38,337 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 02:59:38,337 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 02:59:38,338 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 02:59:38,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-13 02:59:38,338 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 02:59:38,338 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-13 02:59:38,338 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:38,338 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 02:59:38,338 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-13 02:59:38,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-13 02:59:38,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-13 02:59:38,340 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,341 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,341 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,341 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,341 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,342 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:38,342 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,341 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,342 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,342 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:38,342 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:38,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11120186[Count = 1] remaining members to acquire global barrier 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-13 02:59:38,346 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11120186[Count = 0] remaining members to acquire global barrier 2023-09-13 02:59:38,347 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-13 02:59:38,347 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 02:59:38,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-13 02:59:38,351 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,352 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 02:59:38,352 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:38,351 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:38,352 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:38,352 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. started... 2023-09-13 02:59:38,352 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:38,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:38,352 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. started... 2023-09-13 02:59:38,352 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3c25c9d910a9a54d7d91c2a3d1e078c6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-13 02:59:38,352 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3f37ba64e579fe266cce22e692d70eae 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-13 02:59:38,354 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 02:59:38,354 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,354 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 02:59:38,391 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 02:59:38,391 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-13 02:59:38,392 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 02:59:38,392 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-13 02:59:38,392 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-13 02:59:38,392 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-13 02:59:38,392 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 02:59:38,392 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-13 02:59:38,392 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-13 02:59:38,392 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-13 02:59:38,407 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:38,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 02:59:38,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 02:59:38,409 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 02:59:38,491 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913251f1c93dd3f4d2996d159954fc1b735 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913251f1c93dd3f4d2996d159954fc1b735 2023-09-13 02:59:38,491 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913a2e8214ede524de9b7510993ba1d6d33 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913a2e8214ede524de9b7510993ba1d6d33 2023-09-13 02:59:38,528 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/.tmp/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d 2023-09-13 02:59:38,529 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/.tmp/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6 2023-09-13 02:59:38,539 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/.tmp/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6 2023-09-13 02:59:38,539 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/.tmp/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d 2023-09-13 02:59:38,548 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6, entries=47, sequenceid=6, filesize=12.8 K 2023-09-13 02:59:38,548 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d, entries=3, sequenceid=6, filesize=5.4 K 2023-09-13 02:59:38,552 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3f37ba64e579fe266cce22e692d70eae in 200ms, sequenceid=6, compaction requested=false 2023-09-13 02:59:38,552 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-13 02:59:38,552 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3c25c9d910a9a54d7d91c2a3d1e078c6 in 200ms, sequenceid=6, compaction requested=false 2023-09-13 02:59:38,552 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-13 02:59:38,554 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3c25c9d910a9a54d7d91c2a3d1e078c6: 2023-09-13 02:59:38,554 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f37ba64e579fe266cce22e692d70eae: 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6] hfiles 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d] hfiles 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6 for snapshot=snaptb0-testExportWithTargetName 2023-09-13 02:59:38,555 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d for snapshot=snaptb0-testExportWithTargetName 2023-09-13 02:59:38,580 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. completed. 2023-09-13 02:59:38,580 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:38,580 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:38,580 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:38,581 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,581 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 02:59:38,582 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 02:59:38,584 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,584 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 02:59:38,585 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,585 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 02:59:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,588 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. completed. 2023-09-13 02:59:38,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,588 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:38,589 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:38,589 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:38,589 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,589 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-13 02:59:38,589 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 02:59:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,590 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,590 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-13 02:59:38,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,591 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,591 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-13 02:59:38,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 02:59:38,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-13 02:59:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35085,1694573969420': 2023-09-13 02:59:38,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-13 02:59:38,598 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-13 02:59:38,598 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 02:59:38,598 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 02:59:38,598 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-13 02:59:38,598 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:38,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,604 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,605 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,605 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,606 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,608 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:38,609 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-13 02:59:38,609 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,609 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:38,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 02:59:38,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-13 02:59:38,611 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,623 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:38,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:38,624 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:38,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-13 02:59:38,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 02:59:38,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,624 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:38,626 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:38,626 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913251f1c93dd3f4d2996d159954fc1b735, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913a2e8214ede524de9b7510993ba1d6d33] mob files 2023-09-13 02:59:38,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913251f1c93dd3f4d2996d159954fc1b735 2023-09-13 02:59:38,627 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913a2e8214ede524de9b7510993ba1d6d33 2023-09-13 02:59:38,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-13 02:59:38,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-13 02:59:38,682 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,683 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-13 02:59:38,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694573978306Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694573978640 (+334 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694573978640Loading Region manifests for snaptb0-testExportWithTargetName at 1694573978640Writing data manifest for snaptb0-testExportWithTargetName at 1694573978647 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694573978669 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694573978682 (+13 ms) 2023-09-13 02:59:38,685 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-13 02:59:38,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 379 msec 2023-09-13 02:59:38,911 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:38,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-13 02:59:38,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 02:59:38,914 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914 2023-09-13 02:59:38,915 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34433, tgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914, rawTgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:38,956 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:38,956 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1847881336_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-13 02:59:38,956 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-13 02:59:38,976 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-13 02:59:39,444 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:39,445 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:39,445 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:39,446 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,347 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-3596269011747076559.jar 2023-09-13 02:59:40,348 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,348 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,414 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-7627450829704788233.jar 2023-09-13 02:59:40,414 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,415 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,415 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,416 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,416 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,417 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:40,417 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 02:59:40,418 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 02:59:40,418 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 02:59:40,419 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 02:59:40,419 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 02:59:40,420 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 02:59:40,420 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 02:59:40,421 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 02:59:40,421 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 02:59:40,422 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 02:59:40,426 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 02:59:40,427 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:40,428 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:40,428 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 02:59:40,429 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 02:59:41,199 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 02:59:41,205 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-13 02:59:41,213 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-13 02:59:41,674 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 02:59:41,676 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 02:59:42,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0001_000001 (auth:SIMPLE) 2023-09-13 02:59:42,678 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 02:59:46,652 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0001_000001 (auth:SIMPLE) 2023-09-13 02:59:48,917 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0001_000001 (auth:SIMPLE) 2023-09-13 02:59:51,466 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0001_000001 (auth:SIMPLE) 2023-09-13 02:59:53,049 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 02:59:53,053 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 02:59:53,067 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-13 02:59:53,067 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 02:59:53,068 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 02:59:53,068 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-13 02:59:53,069 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-13 02:59:53,069 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-13 02:59:53,069 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914/.hbase-snapshot/testExportWithTargetName 2023-09-13 02:59:53,070 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-13 02:59:53,070 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573978914/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-13 02:59:53,080 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-13 02:59:53,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-09-13 02:59:53,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573993099"}]},"ts":"1694573993099"} 2023-09-13 02:59:53,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 02:59:53,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-13 02:59:53,121 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-13 02:59:53,123 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, UNASSIGN}] 2023-09-13 02:59:53,125 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, UNASSIGN 2023-09-13 02:59:53,125 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, UNASSIGN 2023-09-13 02:59:53,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3f37ba64e579fe266cce22e692d70eae, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:53,126 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3c25c9d910a9a54d7d91c2a3d1e078c6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:53,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573993126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573993126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573993126"}]},"ts":"1694573993126"} 2023-09-13 02:59:53,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573993126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573993126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573993126"}]},"ts":"1694573993126"} 2023-09-13 02:59:53,129 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 3f37ba64e579fe266cce22e692d70eae, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 02:59:53,130 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 3c25c9d910a9a54d7d91c2a3d1e078c6, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 02:59:53,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 02:59:53,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:53,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:53,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3c25c9d910a9a54d7d91c2a3d1e078c6, disabling compactions & flushes 2023-09-13 02:59:53,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3f37ba64e579fe266cce22e692d70eae, disabling compactions & flushes 2023-09-13 02:59:53,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:53,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:53,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:53,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:53,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. after waiting 0 ms 2023-09-13 02:59:53,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. after waiting 0 ms 2023-09-13 02:59:53,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:53,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:53,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 02:59:53,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 02:59:53,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 02:59:53,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 02:59:53,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6. 2023-09-13 02:59:53,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae. 2023-09-13 02:59:53,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3c25c9d910a9a54d7d91c2a3d1e078c6: 2023-09-13 02:59:53,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3f37ba64e579fe266cce22e692d70eae: 2023-09-13 02:59:53,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:53,315 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3c25c9d910a9a54d7d91c2a3d1e078c6, regionState=CLOSED 2023-09-13 02:59:53,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:53,315 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573993315"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573993315"}]},"ts":"1694573993315"} 2023-09-13 02:59:53,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3f37ba64e579fe266cce22e692d70eae, regionState=CLOSED 2023-09-13 02:59:53,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694573993316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573993316"}]},"ts":"1694573993316"} 2023-09-13 02:59:53,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-13 02:59:53,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 3c25c9d910a9a54d7d91c2a3d1e078c6, server=jenkins-hbase9.apache.org,45847,1694573969506 in 188 msec 2023-09-13 02:59:53,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-13 02:59:53,322 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 3f37ba64e579fe266cce22e692d70eae, server=jenkins-hbase9.apache.org,35085,1694573969420 in 190 msec 2023-09-13 02:59:53,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3c25c9d910a9a54d7d91c2a3d1e078c6, UNASSIGN in 198 msec 2023-09-13 02:59:53,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-13 02:59:53,324 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3f37ba64e579fe266cce22e692d70eae, UNASSIGN in 199 msec 2023-09-13 02:59:53,325 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573993325"}]},"ts":"1694573993325"} 2023-09-13 02:59:53,327 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-13 02:59:53,352 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-13 02:59:53,354 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 265 msec 2023-09-13 02:59:53,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-13 02:59:53,403 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-13 02:59:53,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-09-13 02:59:53,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,418 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-13 02:59:53,419 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,423 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-13 02:59:53,425 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:53,425 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:53,431 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/recovered.edits] 2023-09-13 02:59:53,431 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/recovered.edits] 2023-09-13 02:59:53,438 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/cf/70fc5aae3aef4cb5ae0cdeb48d4a359d 2023-09-13 02:59:53,438 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/cf/24bae5d65ad24dbeb0d8448cc7ebc4c6 2023-09-13 02:59:53,442 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae/recovered.edits/9.seqid 2023-09-13 02:59:53,443 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6/recovered.edits/9.seqid 2023-09-13 02:59:53,443 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3f37ba64e579fe266cce22e692d70eae 2023-09-13 02:59:53,443 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportWithTargetName/3c25c9d910a9a54d7d91c2a3d1e078c6 2023-09-13 02:59:53,443 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-13 02:59:53,444 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-13 02:59:53,445 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-13 02:59:53,449 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913251f1c93dd3f4d2996d159954fc1b735 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230913251f1c93dd3f4d2996d159954fc1b735 2023-09-13 02:59:53,451 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913a2e8214ede524de9b7510993ba1d6d33 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230913a2e8214ede524de9b7510993ba1d6d33 2023-09-13 02:59:53,451 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-13 02:59:53,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,476 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-13 02:59:53,479 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-13 02:59:53,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-13 02:59:53,481 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694573993481"}]},"ts":"9223372036854775807"} 2023-09-13 02:59:53,481 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694573993481"}]},"ts":"9223372036854775807"} 2023-09-13 02:59:53,482 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 02:59:53,484 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 02:59:53,484 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 02:59:53,484 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-13 02:59:53,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 02:59:53,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f37ba64e579fe266cce22e692d70eae, NAME => 'testtb-testExportWithTargetName,,1694573976662.3f37ba64e579fe266cce22e692d70eae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3c25c9d910a9a54d7d91c2a3d1e078c6, NAME => 'testtb-testExportWithTargetName,1,1694573976662.3c25c9d910a9a54d7d91c2a3d1e078c6.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 02:59:53,485 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-13 02:59:53,485 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694573993485"}]},"ts":"9223372036854775807"} 2023-09-13 02:59:53,487 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-13 02:59:53,559 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:53,559 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:53,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-13 02:59:53,559 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:53,559 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:53,560 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 02:59:53,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-13 02:59:53,560 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 02:59:53,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-13 02:59:53,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-13 02:59:53,560 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 02:59:53,560 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 02:59:53,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-13 02:59:53,584 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-13 02:59:53,586 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 175 msec 2023-09-13 02:59:53,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-13 02:59:53,664 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-13 02:59:53,684 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-13 02:59:53,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-13 02:59:53,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-09-13 02:59:53,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-13 02:59:53,720 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=757 (was 708) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1466109192_1 at /127.0.0.1:45228 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:45252 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:34247 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:44685 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:38377 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1466109192_1 at /127.0.0.1:40482 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:42604 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:40514 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=143 (was 87) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=6168 (was 6922) 2023-09-13 02:59:53,721 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-13 02:59:53,743 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=757, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=143, ProcessCount=167, AvailableMemoryMB=6167 2023-09-13 02:59:53,743 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-09-13 02:59:53,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 02:59:53,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-13 02:59:53,750 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 02:59:53,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-13 02:59:53,752 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 02:59:53,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 02:59:53,755 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:53,755 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:53,756 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c empty. 2023-09-13 02:59:53,756 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 empty. 2023-09-13 02:59:53,757 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:53,757 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:53,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-13 02:59:53,771 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-13 02:59:53,773 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7d2b30ad3fd91b85f80574424f8adef7, NAME => 'testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 02:59:53,773 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3f5f87df6a9503a83356def12818f07c, NAME => 'testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 02:59:53,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:53,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3f5f87df6a9503a83356def12818f07c, disabling compactions & flushes 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7d2b30ad3fd91b85f80574424f8adef7, disabling compactions & flushes 2023-09-13 02:59:53,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:53,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. after waiting 0 ms 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. after waiting 0 ms 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:53,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:53,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:53,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:53,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3f5f87df6a9503a83356def12818f07c: 2023-09-13 02:59:53,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7d2b30ad3fd91b85f80574424f8adef7: 2023-09-13 02:59:53,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 02:59:53,803 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694573993803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573993803"}]},"ts":"1694573993803"} 2023-09-13 02:59:53,804 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694573993803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694573993803"}]},"ts":"1694573993803"} 2023-09-13 02:59:53,806 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 02:59:53,807 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 02:59:53,807 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573993807"}]},"ts":"1694573993807"} 2023-09-13 02:59:53,809 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-13 02:59:53,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 02:59:53,875 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 02:59:53,876 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 02:59:53,876 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 02:59:53,876 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 02:59:53,876 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 02:59:53,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, ASSIGN}] 2023-09-13 02:59:53,880 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, ASSIGN 2023-09-13 02:59:53,880 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, ASSIGN 2023-09-13 02:59:53,881 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35085,1694573969420; forceNewPlan=false, retain=false 2023-09-13 02:59:53,881 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 02:59:54,031 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 02:59:54,034 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7d2b30ad3fd91b85f80574424f8adef7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,034 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3f5f87df6a9503a83356def12818f07c, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,034 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694573994034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573994034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573994034"}]},"ts":"1694573994034"} 2023-09-13 02:59:54,034 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694573994034"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694573994034"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694573994034"}]},"ts":"1694573994034"} 2023-09-13 02:59:54,036 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 7d2b30ad3fd91b85f80574424f8adef7, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 02:59:54,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 3f5f87df6a9503a83356def12818f07c, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 02:59:54,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 02:59:54,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:54,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:54,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d2b30ad3fd91b85f80574424f8adef7, NAME => 'testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 02:59:54,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3f5f87df6a9503a83356def12818f07c, NAME => 'testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 02:59:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. service=AccessControlService 2023-09-13 02:59:54,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. service=AccessControlService 2023-09-13 02:59:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 02:59:54,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 02:59:54,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,196 INFO [StoreOpener-7d2b30ad3fd91b85f80574424f8adef7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,196 INFO [StoreOpener-3f5f87df6a9503a83356def12818f07c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,197 DEBUG [StoreOpener-7d2b30ad3fd91b85f80574424f8adef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf 2023-09-13 02:59:54,198 DEBUG [StoreOpener-7d2b30ad3fd91b85f80574424f8adef7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf 2023-09-13 02:59:54,198 DEBUG [StoreOpener-3f5f87df6a9503a83356def12818f07c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf 2023-09-13 02:59:54,198 DEBUG [StoreOpener-3f5f87df6a9503a83356def12818f07c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf 2023-09-13 02:59:54,198 INFO [StoreOpener-7d2b30ad3fd91b85f80574424f8adef7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d2b30ad3fd91b85f80574424f8adef7 columnFamilyName cf 2023-09-13 02:59:54,198 INFO [StoreOpener-3f5f87df6a9503a83356def12818f07c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3f5f87df6a9503a83356def12818f07c columnFamilyName cf 2023-09-13 02:59:54,199 INFO [StoreOpener-3f5f87df6a9503a83356def12818f07c-1] regionserver.HStore(310): Store=3f5f87df6a9503a83356def12818f07c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:54,200 INFO [StoreOpener-7d2b30ad3fd91b85f80574424f8adef7-1] regionserver.HStore(310): Store=7d2b30ad3fd91b85f80574424f8adef7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 02:59:54,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3f5f87df6a9503a83356def12818f07c 2023-09-13 02:59:54,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 02:59:54,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:54,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 02:59:54,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3f5f87df6a9503a83356def12818f07c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61362360, jitterRate=-0.08562958240509033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:54,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7d2b30ad3fd91b85f80574424f8adef7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60367759, jitterRate=-0.1004502922296524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 02:59:54,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3f5f87df6a9503a83356def12818f07c: 2023-09-13 02:59:54,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7d2b30ad3fd91b85f80574424f8adef7: 2023-09-13 02:59:54,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7., pid=30, masterSystemTime=1694573994189 2023-09-13 02:59:54,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c., pid=31, masterSystemTime=1694573994190 2023-09-13 02:59:54,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:54,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:54,215 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=3f5f87df6a9503a83356def12818f07c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,215 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694573994215"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694573994215"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694573994215"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694573994215"}]},"ts":"1694573994215"} 2023-09-13 02:59:54,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:54,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:54,217 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7d2b30ad3fd91b85f80574424f8adef7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,218 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694573994217"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694573994217"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694573994217"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694573994217"}]},"ts":"1694573994217"} 2023-09-13 02:59:54,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-13 02:59:54,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 3f5f87df6a9503a83356def12818f07c, server=jenkins-hbase9.apache.org,45847,1694573969506 in 181 msec 2023-09-13 02:59:54,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-13 02:59:54,225 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 7d2b30ad3fd91b85f80574424f8adef7, server=jenkins-hbase9.apache.org,35085,1694573969420 in 184 msec 2023-09-13 02:59:54,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, ASSIGN in 345 msec 2023-09-13 02:59:54,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-13 02:59:54,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, ASSIGN in 347 msec 2023-09-13 02:59:54,228 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 02:59:54,228 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694573994228"}]},"ts":"1694573994228"} 2023-09-13 02:59:54,229 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-13 02:59:54,245 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 02:59:54,245 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-13 02:59:54,247 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 02:59:54,275 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:54,275 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:54,275 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:54,275 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 02:59:54,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:54,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:54,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:54,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 02:59:54,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 551 msec 2023-09-13 02:59:54,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-13 02:59:54,356 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-13 02:59:54,358 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-13 02:59:54,359 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:54,361 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 02:59:54,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 02:59:54,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694573994373 (current time:1694573994373). 2023-09-13 02:59:54,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 02:59:54,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x745dcf59 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:54,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e2fef88, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:54,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:54,394 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:54,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x745dcf59 to 127.0.0.1:53387 2023-09-13 02:59:54,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:54,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x0e17c590 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:54,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@142ae40c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:54,446 DEBUG [hconnection-0x45281aae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:54,449 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:54,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:54,454 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e17c590 to 127.0.0.1:53387 2023-09-13 02:59:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 02:59:54,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 02:59:54,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 02:59:54,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 02:59:54,460 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 02:59:54,460 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694574594460 2023-09-13 02:59:54,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-13 02:59:54,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 02:59:54,462 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 02:59:54,462 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 02:59:54,463 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 02:59:54,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 02:59:54,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-13 02:59:54,465 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 02:59:54,466 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694574594466 2023-09-13 02:59:54,477 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,477 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-13 02:59:54,477 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:54,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-13 02:59:54,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-13 02:59:54,479 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,479 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,506 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:54,506 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:54,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:54,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:54,506 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:54,506 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,506 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,507 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,507 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,507 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 02:59:54,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,508 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 02:59:54,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,508 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 02:59:54,508 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 02:59:54,508 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,508 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:54,508 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 02:59:54,510 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 02:59:54,510 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 02:59:54,510 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 02:59:54,510 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:54,508 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:54,511 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 02:59:54,511 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 02:59:54,512 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 02:59:54,512 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 02:59:54,512 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-13 02:59:54,512 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-13 02:59:54,529 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,529 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:54,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:54,562 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:54,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 02:59:54,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 02:59:54,563 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 02:59:54,714 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,744 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,744 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:54,744 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,744 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:54,744 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,744 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:54,745 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,745 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e2f61d8[Count = 1] remaining members to acquire global barrier 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:54,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-13 02:59:54,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e2f61d8[Count = 0] remaining members to acquire global barrier 2023-09-13 02:59:54,749 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 02:59:54,749 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,763 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:54,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 02:59:54,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 02:59:54,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-13 02:59:54,775 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 02:59:54,775 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,775 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 02:59:54,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,775 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:54,776 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:54,776 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 02:59:54,776 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. started... 2023-09-13 02:59:54,776 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,776 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 02:59:54,776 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:54,776 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 02:59:54,776 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. started... 2023-09-13 02:59:54,776 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f5f87df6a9503a83356def12818f07c: 2023-09-13 02:59:54,776 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:54,776 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:54,777 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d2b30ad3fd91b85f80574424f8adef7: 2023-09-13 02:59:54,776 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:54,778 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,776 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 02:59:54,778 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:54,778 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,778 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 02:59:54,778 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:54,778 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 02:59:54,803 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. completed. 2023-09-13 02:59:54,803 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 02:59:54,803 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. completed. 2023-09-13 02:59:54,803 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,803 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-13 02:59:54,804 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 02:59:54,806 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 02:59:54,806 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:54,806 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 02:59:54,829 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 02:59:54,829 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,829 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:54,829 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 02:59:54,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:54,844 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 02:59:54,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:54,844 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:54,844 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,844 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-13 02:59:54,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:54,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 02:59:54,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 02:59:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:54,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:54,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,35085,1694573969420': 2023-09-13 02:59:54,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 02:59:54,855 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-13 02:59:54,855 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 02:59:54,855 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 02:59:54,855 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,855 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:54,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,857 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:54,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:54,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:54,858 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:54,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,859 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:54,860 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,864 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,864 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,865 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,868 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:54,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:54,869 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:54,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,871 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-13 02:59:54,869 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:54,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:54,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:54,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 02:59:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:54,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:54,871 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,872 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 02:59:54,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:54,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:54,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:54,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,915 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-13 02:59:54,916 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,917 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-13 02:59:54,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,918 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-13 02:59:54,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694573994461Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694573994889 (+428 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694573994889Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694573994889Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694573994896 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694573994909 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694573994917 (+8 ms) 2023-09-13 02:59:54,921 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 02:59:54,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 460 msec 2023-09-13 02:59:55,065 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:55,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 02:59:55,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 02:59:55,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 02:59:55,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35085] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 02:59:55,078 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-13 02:59:55,078 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:55,078 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 02:59:55,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 02:59:55,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694573995091 (current time:1694573995091). 2023-09-13 02:59:55,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 02:59:55,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x5465086c to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:55,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dfd08fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:55,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:55,106 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:55,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5465086c to 127.0.0.1:53387 2023-09-13 02:59:55,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:55,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x02dd2d67 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 02:59:55,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1bd83efc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 02:59:55,115 DEBUG [hconnection-0x2e8ed042-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:55,117 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:55,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 02:59:55,124 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44890, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 02:59:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02dd2d67 to 127.0.0.1:53387 2023-09-13 02:59:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 02:59:55,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 02:59:55,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 02:59:55,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 02:59:55,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 02:59:55,130 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 02:59:55,131 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694574595131 2023-09-13 02:59:55,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-13 02:59:55,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 02:59:55,132 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 02:59:55,132 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 02:59:55,135 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-13 02:59:55,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 02:59:55,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-13 02:59:55,138 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 02:59:55,138 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694574595138 2023-09-13 02:59:55,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-13 02:59:55,158 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-13 02:59:55,158 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:55,160 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-13 02:59:55,160 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-13 02:59:55,160 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,161 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,162 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:55,162 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:55,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:55,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:55,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:55,162 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:55,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:55,162 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:55,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:55,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,163 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,163 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 02:59:55,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 02:59:55,165 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 02:59:55,165 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 02:59:55,165 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:55,165 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 02:59:55,165 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:55,170 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 02:59:55,170 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 02:59:55,170 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 02:59:55,170 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 02:59:55,170 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 02:59:55,170 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 02:59:55,170 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,170 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 02:59:55,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-13 02:59:55,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-13 02:59:55,171 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,171 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:55,172 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,172 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:55,172 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:55,172 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-13 02:59:55,173 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-13 02:59:55,173 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,173 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:55,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:55,173 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 02:59:55,174 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-13 02:59:55,174 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-13 02:59:55,174 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-13 02:59:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,178 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,178 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,178 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 02:59:55,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:55,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-13 02:59:55,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28d964d9[Count = 1] remaining members to acquire global barrier 2023-09-13 02:59:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:55,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:55,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-13 02:59:55,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28d964d9[Count = 0] remaining members to acquire global barrier 2023-09-13 02:59:55,182 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 02:59:55,182 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,183 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,183 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,183 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 02:59:55,184 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:55,184 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:55,184 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 02:59:55,184 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:55,184 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,184 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. started... 2023-09-13 02:59:55,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,184 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 02:59:55,184 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 02:59:55,185 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 02:59:55,185 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-13 02:59:55,185 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3f5f87df6a9503a83356def12818f07c 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-09-13 02:59:55,185 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 02:59:55,185 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 02:59:55,185 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:55,185 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. started... 2023-09-13 02:59:55,185 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7d2b30ad3fd91b85f80574424f8adef7 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-09-13 02:59:55,186 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 02:59:55,186 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:55,186 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 02:59:55,229 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091349e89ce587e640cc99357a992f2794ee to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023091349e89ce587e640cc99357a992f2794ee 2023-09-13 02:59:55,230 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913adcc2e7cef934aaf91ecc7040d310462 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913adcc2e7cef934aaf91ecc7040d310462 2023-09-13 02:59:55,233 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:55,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 02:59:55,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 02:59:55,240 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 02:59:55,252 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/.tmp/cf/27b45d7a4ea34316a3895c05bad43aa9 2023-09-13 02:59:55,254 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/.tmp/cf/f604bcc94ed84901b46346ceb8981f06 2023-09-13 02:59:55,259 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/.tmp/cf/27b45d7a4ea34316a3895c05bad43aa9 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf/27b45d7a4ea34316a3895c05bad43aa9 2023-09-13 02:59:55,261 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/.tmp/cf/f604bcc94ed84901b46346ceb8981f06 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf/f604bcc94ed84901b46346ceb8981f06 2023-09-13 02:59:55,266 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf/27b45d7a4ea34316a3895c05bad43aa9, entries=7, sequenceid=6, filesize=6.1 K 2023-09-13 02:59:55,267 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for 3f5f87df6a9503a83356def12818f07c in 82ms, sequenceid=6, compaction requested=false 2023-09-13 02:59:55,269 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3f5f87df6a9503a83356def12818f07c: 2023-09-13 02:59:55,269 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 02:59:55,269 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:55,269 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf/27b45d7a4ea34316a3895c05bad43aa9] hfiles 2023-09-13 02:59:55,269 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf/27b45d7a4ea34316a3895c05bad43aa9 for snapshot=snaptb0-testExportFileSystemState 2023-09-13 02:59:55,271 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf/f604bcc94ed84901b46346ceb8981f06, entries=43, sequenceid=6, filesize=12.2 K 2023-09-13 02:59:55,272 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 7d2b30ad3fd91b85f80574424f8adef7 in 87ms, sequenceid=6, compaction requested=false 2023-09-13 02:59:55,272 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d2b30ad3fd91b85f80574424f8adef7: 2023-09-13 02:59:55,272 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 02:59:55,272 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 02:59:55,272 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf/f604bcc94ed84901b46346ceb8981f06] hfiles 2023-09-13 02:59:55,273 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf/f604bcc94ed84901b46346ceb8981f06 for snapshot=snaptb0-testExportFileSystemState 2023-09-13 02:59:55,284 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. completed. 2023-09-13 02:59:55,284 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 02:59:55,284 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:55,284 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:55,284 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,284 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 02:59:55,284 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 02:59:55,287 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. completed. 2023-09-13 02:59:55,287 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 02:59:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 02:59:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 02:59:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-13 02:59:55,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 02:59:55,290 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 02:59:55,290 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,290 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:55,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:55,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:55,290 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 02:59:55,292 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-13 02:59:55,292 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:55,292 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,292 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-13 02:59:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:55,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 02:59:55,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 02:59:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:55,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,35085,1694573969420': 2023-09-13 02:59:55,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 02:59:55,300 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-13 02:59:55,300 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 02:59:55,300 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 02:59:55,300 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-13 02:59:55,300 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 02:59:55,302 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,302 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,302 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:55,302 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:55,302 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,303 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,303 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 02:59:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 02:59:55,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:55,303 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:55,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 02:59:55,304 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,305 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 02:59:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,307 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 02:59:55,307 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-13 02:59:55,307 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,310 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,310 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:55,311 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:55,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:55,310 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,311 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:55,312 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:55,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:55,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:55,311 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 02:59:55,312 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:55,312 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 02:59:55,312 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:55,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 02:59:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 02:59:55,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:55,313 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,313 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,313 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 02:59:55,313 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,313 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 02:59:55,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:55,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:55,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-13 02:59:55,313 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 02:59:55,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-13 02:59:55,314 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 02:59:55,314 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-13 02:59:55,314 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 02:59:55,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 02:59:55,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 02:59:55,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913adcc2e7cef934aaf91ecc7040d310462, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023091349e89ce587e640cc99357a992f2794ee] mob files 2023-09-13 02:59:55,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913adcc2e7cef934aaf91ecc7040d310462 2023-09-13 02:59:55,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023091349e89ce587e640cc99357a992f2794ee 2023-09-13 02:59:55,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-13 02:59:55,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,356 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-13 02:59:55,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,357 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,357 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694573995131Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694573995327 (+196 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694573995327Loading Region manifests for snaptb0-testExportFileSystemState at 1694573995327Writing data manifest for snaptb0-testExportFileSystemState at 1694573995332 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694573995347 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694573995357 (+10 ms) 2023-09-13 02:59:55,360 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-13 02:59:55,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 228 msec 2023-09-13 02:59:55,440 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 02:59:55,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 02:59:55,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 02:59:55,442 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442 2023-09-13 02:59:55,442 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34433, tgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442, rawTgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:55,471 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 02:59:55,471 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_71119433_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,471 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-13 02:59:55,486 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-13 02:59:55,511 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:55,512 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:55,512 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:55,512 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,405 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-1735082606480065196.jar 2023-09-13 02:59:56,406 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,406 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,472 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-4547463014307609145.jar 2023-09-13 02:59:56,473 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,473 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,473 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,474 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,474 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,474 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 02:59:56,475 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 02:59:56,475 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 02:59:56,475 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 02:59:56,476 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 02:59:56,476 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 02:59:56,477 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 02:59:56,477 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 02:59:56,477 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 02:59:56,478 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 02:59:56,478 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 02:59:56,479 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:56,479 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:56,480 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 02:59:56,480 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:56,480 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 02:59:56,481 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 02:59:56,481 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 02:59:56,938 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 02:59:56,941 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-13 02:59:56,944 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-13 02:59:57,655 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 02:59:57,655 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 02:59:57,661 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0001_000001 (auth:SIMPLE) 2023-09-13 02:59:58,587 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0002_000001 (auth:SIMPLE) 2023-09-13 02:59:58,895 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 03:00:02,629 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0002_000001 (auth:SIMPLE) 2023-09-13 03:00:04,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0002_000001 (auth:SIMPLE) 2023-09-13 03:00:07,546 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0002_000001 (auth:SIMPLE) 2023-09-13 03:00:09,145 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 03:00:09,145 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 03:00:09,154 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-13 03:00:09,154 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 03:00:09,155 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 03:00:09,155 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 03:00:09,156 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-13 03:00:09,156 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-13 03:00:09,156 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-13 03:00:09,156 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-13 03:00:09,156 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694573995442/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-13 03:00:09,163 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-13 03:00:09,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-09-13 03:00:09,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 03:00:09,168 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574009168"}]},"ts":"1694574009168"} 2023-09-13 03:00:09,170 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-13 03:00:09,172 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-13 03:00:09,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, UNASSIGN}] 2023-09-13 03:00:09,175 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, UNASSIGN 2023-09-13 03:00:09,175 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, UNASSIGN 2023-09-13 03:00:09,176 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3f5f87df6a9503a83356def12818f07c, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:09,176 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7d2b30ad3fd91b85f80574424f8adef7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:09,176 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694574009176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574009176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574009176"}]},"ts":"1694574009176"} 2023-09-13 03:00:09,176 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694574009176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574009176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574009176"}]},"ts":"1694574009176"} 2023-09-13 03:00:09,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 3f5f87df6a9503a83356def12818f07c, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:09,179 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 7d2b30ad3fd91b85f80574424f8adef7, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 03:00:09,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 03:00:09,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3f5f87df6a9503a83356def12818f07c 2023-09-13 03:00:09,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3f5f87df6a9503a83356def12818f07c, disabling compactions & flushes 2023-09-13 03:00:09,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 03:00:09,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 03:00:09,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. after waiting 0 ms 2023-09-13 03:00:09,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 03:00:09,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 03:00:09,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7d2b30ad3fd91b85f80574424f8adef7, disabling compactions & flushes 2023-09-13 03:00:09,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 03:00:09,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 03:00:09,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. after waiting 0 ms 2023-09-13 03:00:09,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 03:00:09,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:00:09,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:09,341 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:00:09,342 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c. 2023-09-13 03:00:09,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3f5f87df6a9503a83356def12818f07c: 2023-09-13 03:00:09,342 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:09,343 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7. 2023-09-13 03:00:09,343 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7d2b30ad3fd91b85f80574424f8adef7: 2023-09-13 03:00:09,344 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3f5f87df6a9503a83356def12818f07c 2023-09-13 03:00:09,345 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=3f5f87df6a9503a83356def12818f07c, regionState=CLOSED 2023-09-13 03:00:09,345 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694574009345"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574009345"}]},"ts":"1694574009345"} 2023-09-13 03:00:09,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 03:00:09,346 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7d2b30ad3fd91b85f80574424f8adef7, regionState=CLOSED 2023-09-13 03:00:09,346 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694574009346"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574009346"}]},"ts":"1694574009346"} 2023-09-13 03:00:09,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-13 03:00:09,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 3f5f87df6a9503a83356def12818f07c, server=jenkins-hbase9.apache.org,45847,1694573969506 in 169 msec 2023-09-13 03:00:09,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-13 03:00:09,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 7d2b30ad3fd91b85f80574424f8adef7, server=jenkins-hbase9.apache.org,35085,1694573969420 in 169 msec 2023-09-13 03:00:09,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=3f5f87df6a9503a83356def12818f07c, UNASSIGN in 176 msec 2023-09-13 03:00:09,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-13 03:00:09,352 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7d2b30ad3fd91b85f80574424f8adef7, UNASSIGN in 177 msec 2023-09-13 03:00:09,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574009353"}]},"ts":"1694574009353"} 2023-09-13 03:00:09,354 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-13 03:00:09,356 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-13 03:00:09,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 194 msec 2023-09-13 03:00:09,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-13 03:00:09,470 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-13 03:00:09,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-09-13 03:00:09,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-13 03:00:09,475 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,476 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-13 03:00:09,479 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,479 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,479 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,479 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 03:00:09,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 03:00:09,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 03:00:09,480 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-13 03:00:09,481 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c 2023-09-13 03:00:09,481 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 03:00:09,483 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/recovered.edits] 2023-09-13 03:00:09,483 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/recovered.edits] 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-13 03:00:09,486 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:09,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-13 03:00:09,488 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf/f604bcc94ed84901b46346ceb8981f06 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/cf/f604bcc94ed84901b46346ceb8981f06 2023-09-13 03:00:09,490 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf/27b45d7a4ea34316a3895c05bad43aa9 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/cf/27b45d7a4ea34316a3895c05bad43aa9 2023-09-13 03:00:09,491 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7/recovered.edits/9.seqid 2023-09-13 03:00:09,492 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/7d2b30ad3fd91b85f80574424f8adef7 2023-09-13 03:00:09,493 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c/recovered.edits/9.seqid 2023-09-13 03:00:09,493 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemState/3f5f87df6a9503a83356def12818f07c 2023-09-13 03:00:09,493 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-13 03:00:09,494 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-13 03:00:09,495 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-13 03:00:09,498 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913adcc2e7cef934aaf91ecc7040d310462 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230913adcc2e7cef934aaf91ecc7040d310462 2023-09-13 03:00:09,499 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023091349e89ce587e640cc99357a992f2794ee to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023091349e89ce587e640cc99357a992f2794ee 2023-09-13 03:00:09,499 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-13 03:00:09,501 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,503 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-13 03:00:09,506 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-13 03:00:09,508 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,508 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-13 03:00:09,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574009508"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:09,508 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574009508"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:09,510 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 03:00:09,510 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3f5f87df6a9503a83356def12818f07c, NAME => 'testtb-testExportFileSystemState,,1694573993745.3f5f87df6a9503a83356def12818f07c.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7d2b30ad3fd91b85f80574424f8adef7, NAME => 'testtb-testExportFileSystemState,1,1694573993745.7d2b30ad3fd91b85f80574424f8adef7.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 03:00:09,510 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-13 03:00:09,511 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694574009510"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:09,512 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-13 03:00:09,514 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-13 03:00:09,516 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-09-13 03:00:09,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-13 03:00:09,589 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-13 03:00:09,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-13 03:00:09,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-13 03:00:09,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-09-13 03:00:09,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-13 03:00:09,625 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=766 (was 757) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:41229 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:53700 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:48010 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1818600100_1 at /127.0.0.1:53668 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1963 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:44985 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_71119433_17 at /127.0.0.1:56344 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=192 (was 143) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=6026 (was 6167) 2023-09-13 03:00:09,625 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-13 03:00:09,643 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=192, ProcessCount=167, AvailableMemoryMB=6025 2023-09-13 03:00:09,643 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-13 03:00:09,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 03:00:09,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:09,648 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 03:00:09,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-13 03:00:09,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 03:00:09,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 03:00:09,651 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:09,651 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:09,652 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca empty. 2023-09-13 03:00:09,652 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 empty. 2023-09-13 03:00:09,652 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:09,652 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:09,653 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-13 03:00:09,668 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-13 03:00:09,670 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 950ee9df5db4818e16e1c7e5330240ca, NAME => 'testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:09,670 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5b3e2f50fbb4549fa89223153fefafe3, NAME => 'testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:09,691 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:09,691 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:09,691 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 950ee9df5db4818e16e1c7e5330240ca, disabling compactions & flushes 2023-09-13 03:00:09,691 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 5b3e2f50fbb4549fa89223153fefafe3, disabling compactions & flushes 2023-09-13 03:00:09,691 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:09,691 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:09,691 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:09,691 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:09,692 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. after waiting 0 ms 2023-09-13 03:00:09,692 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. after waiting 0 ms 2023-09-13 03:00:09,692 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:09,692 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:09,692 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:09,692 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:09,692 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 950ee9df5db4818e16e1c7e5330240ca: 2023-09-13 03:00:09,692 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 5b3e2f50fbb4549fa89223153fefafe3: 2023-09-13 03:00:09,694 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 03:00:09,695 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574009695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574009695"}]},"ts":"1694574009695"} 2023-09-13 03:00:09,695 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574009695"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574009695"}]},"ts":"1694574009695"} 2023-09-13 03:00:09,698 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 03:00:09,699 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 03:00:09,699 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574009699"}]},"ts":"1694574009699"} 2023-09-13 03:00:09,701 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-13 03:00:09,704 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 03:00:09,705 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 03:00:09,705 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 03:00:09,705 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 03:00:09,705 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 03:00:09,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, ASSIGN}] 2023-09-13 03:00:09,708 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, ASSIGN 2023-09-13 03:00:09,708 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, ASSIGN 2023-09-13 03:00:09,709 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 03:00:09,709 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44723,1694573969468; forceNewPlan=false, retain=false 2023-09-13 03:00:09,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 03:00:09,859 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 03:00:09,862 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5b3e2f50fbb4549fa89223153fefafe3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:09,862 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=950ee9df5db4818e16e1c7e5330240ca, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:09,862 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574009862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574009862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574009862"}]},"ts":"1694574009862"} 2023-09-13 03:00:09,862 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574009862"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574009862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574009862"}]},"ts":"1694574009862"} 2023-09-13 03:00:09,864 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 5b3e2f50fbb4549fa89223153fefafe3, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:09,865 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 950ee9df5db4818e16e1c7e5330240ca, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:09,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 03:00:10,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b3e2f50fbb4549fa89223153fefafe3, NAME => 'testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. service=AccessControlService 2023-09-13 03:00:10,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 950ee9df5db4818e16e1c7e5330240ca, NAME => 'testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 03:00:10,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. service=AccessControlService 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,022 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,024 INFO [StoreOpener-950ee9df5db4818e16e1c7e5330240ca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,024 INFO [StoreOpener-5b3e2f50fbb4549fa89223153fefafe3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,025 DEBUG [StoreOpener-950ee9df5db4818e16e1c7e5330240ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf 2023-09-13 03:00:10,025 DEBUG [StoreOpener-5b3e2f50fbb4549fa89223153fefafe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf 2023-09-13 03:00:10,025 DEBUG [StoreOpener-5b3e2f50fbb4549fa89223153fefafe3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf 2023-09-13 03:00:10,025 DEBUG [StoreOpener-950ee9df5db4818e16e1c7e5330240ca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf 2023-09-13 03:00:10,026 INFO [StoreOpener-5b3e2f50fbb4549fa89223153fefafe3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b3e2f50fbb4549fa89223153fefafe3 columnFamilyName cf 2023-09-13 03:00:10,026 INFO [StoreOpener-950ee9df5db4818e16e1c7e5330240ca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 950ee9df5db4818e16e1c7e5330240ca columnFamilyName cf 2023-09-13 03:00:10,027 INFO [StoreOpener-950ee9df5db4818e16e1c7e5330240ca-1] regionserver.HStore(310): Store=950ee9df5db4818e16e1c7e5330240ca/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:10,027 INFO [StoreOpener-5b3e2f50fbb4549fa89223153fefafe3-1] regionserver.HStore(310): Store=5b3e2f50fbb4549fa89223153fefafe3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:10,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:10,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:10,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:10,033 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5b3e2f50fbb4549fa89223153fefafe3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65513924, jitterRate=-0.02376645803451538}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:10,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:10,033 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5b3e2f50fbb4549fa89223153fefafe3: 2023-09-13 03:00:10,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 950ee9df5db4818e16e1c7e5330240ca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72569199, jitterRate=0.08136533200740814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:10,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 950ee9df5db4818e16e1c7e5330240ca: 2023-09-13 03:00:10,034 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3., pid=45, masterSystemTime=1694574010016 2023-09-13 03:00:10,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca., pid=46, masterSystemTime=1694574010017 2023-09-13 03:00:10,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=5b3e2f50fbb4549fa89223153fefafe3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574010037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574010037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574010037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574010037"}]},"ts":"1694574010037"} 2023-09-13 03:00:10,038 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=950ee9df5db4818e16e1c7e5330240ca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574010038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574010038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574010038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574010038"}]},"ts":"1694574010038"} 2023-09-13 03:00:10,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-13 03:00:10,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 5b3e2f50fbb4549fa89223153fefafe3, server=jenkins-hbase9.apache.org,45847,1694573969506 in 175 msec 2023-09-13 03:00:10,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-13 03:00:10,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 950ee9df5db4818e16e1c7e5330240ca, server=jenkins-hbase9.apache.org,44723,1694573969468 in 175 msec 2023-09-13 03:00:10,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, ASSIGN in 337 msec 2023-09-13 03:00:10,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-13 03:00:10,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, ASSIGN in 339 msec 2023-09-13 03:00:10,047 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 03:00:10,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574010047"}]},"ts":"1694574010047"} 2023-09-13 03:00:10,048 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-13 03:00:10,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 03:00:10,052 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-13 03:00:10,053 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 03:00:10,055 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:10,055 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:10,055 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:10,055 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:10,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:10,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:10,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:10,057 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:10,057 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 411 msec 2023-09-13 03:00:10,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-13 03:00:10,253 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-13 03:00:10,255 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-13 03:00:10,255 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,258 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:00:10,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 03:00:10,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574010269 (current time:1694574010269). 2023-09-13 03:00:10,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:10,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x1f2c7b8b to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:10,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76b5a889, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:10,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:10,281 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:10,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f2c7b8b to 127.0.0.1:53387 2023-09-13 03:00:10,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:10,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x2489cd64 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:10,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58850a5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:10,291 DEBUG [hconnection-0x3af1024-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:10,294 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48382, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:10,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:10,299 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:10,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2489cd64 to 127.0.0.1:53387 2023-09-13 03:00:10,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:10,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 03:00:10,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:10,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 03:00:10,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 03:00:10,303 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 03:00:10,304 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694574610304 2023-09-13 03:00:10,304 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-13 03:00:10,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 03:00:10,305 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:10,305 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:10,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 03:00:10,308 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 03:00:10,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-13 03:00:10,310 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 03:00:10,311 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694574610311 2023-09-13 03:00:10,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,320 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-13 03:00:10,320 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,321 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-13 03:00:10,321 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-13 03:00:10,321 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,321 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,322 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,322 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,322 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,322 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,323 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,323 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,323 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,323 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,324 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 03:00:10,325 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 03:00:10,325 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,325 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,326 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 03:00:10,326 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 03:00:10,325 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 03:00:10,326 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 03:00:10,326 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 03:00:10,326 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 03:00:10,326 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,327 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 03:00:10,329 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 03:00:10,330 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-13 03:00:10,330 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-13 03:00:10,332 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,332 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,332 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:10,333 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:10,333 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:10,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29464e75[Count = 1] remaining members to acquire global barrier 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-13 03:00:10,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29464e75[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:10,337 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-13 03:00:10,338 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 03:00:10,339 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:10,339 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. started... 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 03:00:10,339 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,339 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:10,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 03:00:10,339 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:10,340 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b3e2f50fbb4549fa89223153fefafe3: 2023-09-13 03:00:10,340 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:10,340 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,340 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:10,341 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. started... 2023-09-13 03:00:10,341 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,341 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:10,341 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:00:10,341 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 950ee9df5db4818e16e1c7e5330240ca: 2023-09-13 03:00:10,341 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,342 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:10,342 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:00:10,349 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 03:00:10,349 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,349 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 03:00:10,354 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. completed. 2023-09-13 03:00:10,354 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:10,354 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. completed. 2023-09-13 03:00:10,354 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,354 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:10,355 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-13 03:00:10,355 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:10,356 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 03:00:10,356 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,356 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,356 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 03:00:10,356 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 03:00:10,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,356 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,357 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,357 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-13 03:00:10,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:00:10,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-13 03:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:00:10,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-13 03:00:10,365 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-13 03:00:10,365 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:10,365 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:10,365 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,365 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,367 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,368 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,369 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,369 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,371 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,371 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,372 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,374 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,375 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,375 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,375 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:00:10,376 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,376 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 03:00:10,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,405 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-13 03:00:10,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,405 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:10,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694574010304Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694574010388 (+84 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694574010388Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694574010388Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694574010391 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694574010399 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694574010405 (+6 ms) 2023-09-13 03:00:10,406 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:10,407 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 03:00:10,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 03:00:10,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:10,409 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 102 msec 2023-09-13 03:00:10,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44723] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:00:10,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:00:10,415 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-13 03:00:10,415 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,415 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:00:10,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 03:00:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574010424 (current time:1694574010424). 2023-09-13 03:00:10,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:10,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x1ca6419c to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:10,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42424313, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:10,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:10,438 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:10,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ca6419c to 127.0.0.1:53387 2023-09-13 03:00:10,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:10,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x11270bfb to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:10,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fa302e2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:10,449 DEBUG [hconnection-0x6fa984de-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:10,451 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:10,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:10,456 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:43858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:10,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11270bfb to 127.0.0.1:53387 2023-09-13 03:00:10,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-13 03:00:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:10,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 03:00:10,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 03:00:10,460 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 03:00:10,461 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694574610461 2023-09-13 03:00:10,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-13 03:00:10,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-13 03:00:10,462 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:10,462 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:10,463 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-13 03:00:10,463 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 03:00:10,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 4 msec 2023-09-13 03:00:10,465 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 03:00:10,466 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694574610466 2023-09-13 03:00:10,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-13 03:00:10,474 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-13 03:00:10,474 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,475 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-13 03:00:10,475 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-13 03:00:10,475 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,475 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,478 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,478 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,478 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,478 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,479 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 03:00:10,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 03:00:10,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-13 03:00:10,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 03:00:10,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 03:00:10,480 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 03:00:10,480 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,480 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-13 03:00:10,481 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 03:00:10,481 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-13 03:00:10,481 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 03:00:10,481 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,481 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 03:00:10,482 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 03:00:10,482 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 03:00:10,481 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:10,482 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 03:00:10,483 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-13 03:00:10,483 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-13 03:00:10,483 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 03:00:10,482 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-13 03:00:10,484 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,484 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,485 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,485 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,485 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,485 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,486 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:10,486 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,486 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:10,486 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,486 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:10,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-13 03:00:10,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f8269db[Count = 1] remaining members to acquire global barrier 2023-09-13 03:00:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-13 03:00:10,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f8269db[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:10,491 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-13 03:00:10,491 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 03:00:10,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,492 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 03:00:10,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,493 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:10,493 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,493 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:10,493 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. started... 2023-09-13 03:00:10,493 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,493 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:10,494 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. started... 2023-09-13 03:00:10,494 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b3e2f50fbb4549fa89223153fefafe3 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-13 03:00:10,494 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 950ee9df5db4818e16e1c7e5330240ca 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-13 03:00:10,496 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 03:00:10,496 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,496 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 03:00:10,526 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091389ece84286e849e18936e7a17012d641 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091389ece84286e849e18936e7a17012d641 2023-09-13 03:00:10,528 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913f02e588a9ca14133bc70cfdea5188773 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913f02e588a9ca14133bc70cfdea5188773 2023-09-13 03:00:10,532 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/.tmp/cf/f66e049eca254f4bacad425fe5d527a3 2023-09-13 03:00:10,536 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/.tmp/cf/d2f1fc2fec8448229881d3ec73d1d255 2023-09-13 03:00:10,538 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/.tmp/cf/f66e049eca254f4bacad425fe5d527a3 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf/f66e049eca254f4bacad425fe5d527a3 2023-09-13 03:00:10,541 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/.tmp/cf/d2f1fc2fec8448229881d3ec73d1d255 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf/d2f1fc2fec8448229881d3ec73d1d255 2023-09-13 03:00:10,548 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf/f66e049eca254f4bacad425fe5d527a3, entries=44, sequenceid=6, filesize=12.2 K 2023-09-13 03:00:10,548 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf/d2f1fc2fec8448229881d3ec73d1d255, entries=6, sequenceid=6, filesize=5.9 K 2023-09-13 03:00:10,549 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 5b3e2f50fbb4549fa89223153fefafe3 in 55ms, sequenceid=6, compaction requested=false 2023-09-13 03:00:10,549 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-13 03:00:10,549 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 950ee9df5db4818e16e1c7e5330240ca in 55ms, sequenceid=6, compaction requested=false 2023-09-13 03:00:10,549 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 950ee9df5db4818e16e1c7e5330240ca: 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b3e2f50fbb4549fa89223153fefafe3: 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf/f66e049eca254f4bacad425fe5d527a3] hfiles 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf/d2f1fc2fec8448229881d3ec73d1d255] hfiles 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf/f66e049eca254f4bacad425fe5d527a3 for snapshot=snaptb0-testConsecutiveExports 2023-09-13 03:00:10,551 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf/d2f1fc2fec8448229881d3ec73d1d255 for snapshot=snaptb0-testConsecutiveExports 2023-09-13 03:00:10,563 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 03:00:10,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:00:10,564 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:00:10,567 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. completed. 2023-09-13 03:00:10,567 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:10,567 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:10,567 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:10,567 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,567 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 03:00:10,567 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:10,568 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. completed. 2023-09-13 03:00:10,568 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 03:00:10,569 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,569 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,570 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 03:00:10,572 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,572 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-13 03:00:10,572 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,572 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-13 03:00:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:00:10,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-13 03:00:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:00:10,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-13 03:00:10,580 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-13 03:00:10,580 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:10,580 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:10,580 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-13 03:00:10,580 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:10,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,582 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,583 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:10,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,583 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,584 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:10,586 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-13 03:00:10,587 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,591 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,598 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:10,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,599 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:10,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,598 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:10,599 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:10,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-13 03:00:10,599 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,600 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:10,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-13 03:00:10,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:10,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:10,600 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:00:10,600 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:10,600 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:10,600 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,600 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091389ece84286e849e18936e7a17012d641, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913f02e588a9ca14133bc70cfdea5188773] mob files 2023-09-13 03:00:10,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091389ece84286e849e18936e7a17012d641 2023-09-13 03:00:10,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913f02e588a9ca14133bc70cfdea5188773 2023-09-13 03:00:10,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-13 03:00:10,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-13 03:00:10,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,629 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694574010461Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694574010608 (+147 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694574010608Loading Region manifests for snaptb0-testConsecutiveExports at 1694574010608Writing data manifest for snaptb0-testConsecutiveExports at 1694574010611 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694574010621 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694574010628 (+7 ms) 2023-09-13 03:00:10,631 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-13 03:00:10,632 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 169 msec 2023-09-13 03:00:10,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:10,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-13 03:00:10,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:10,765 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765 2023-09-13 03:00:10,766 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:10,787 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:10,787 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@280537ea, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,787 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-13 03:00:10,796 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:10,808 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:10,808 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:10,809 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:10,809 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,655 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-8406954747340659972.jar 2023-09-13 03:00:11,656 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,656 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,720 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-7255165200140067922.jar 2023-09-13 03:00:11,721 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,721 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,721 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,722 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,722 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,722 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:11,723 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 03:00:11,723 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 03:00:11,723 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 03:00:11,724 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 03:00:11,724 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 03:00:11,724 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 03:00:11,725 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 03:00:11,725 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 03:00:11,725 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 03:00:11,726 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 03:00:11,726 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:11,727 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:11,727 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:11,728 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:11,728 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:11,728 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:11,729 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:12,098 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 03:00:12,100 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-13 03:00:12,102 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-13 03:00:13,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:13,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:13,718 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0002_000001 (auth:SIMPLE) 2023-09-13 03:00:14,666 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0003_000001 (auth:SIMPLE) 2023-09-13 03:00:14,916 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 03:00:18,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0003_000001 (auth:SIMPLE) 2023-09-13 03:00:20,453 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0003_000001 (auth:SIMPLE) 2023-09-13 03:00:22,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0003_000001 (auth:SIMPLE) 2023-09-13 03:00:24,287 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 03:00:24,287 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 03:00:24,292 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-13 03:00:24,292 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 03:00:24,293 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 03:00:24,293 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 03:00:24,296 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 03:00:24,296 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 03:00:24,296 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@50621125 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 03:00:24,296 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 03:00:24,296 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 03:00:24,298 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:24,319 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:24,319 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1f9a3eed, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:24,319 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-13 03:00:24,329 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-13 03:00:24,340 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:24,340 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:24,340 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:24,341 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,187 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-8670691285489754122.jar 2023-09-13 03:00:25,187 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,188 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,252 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-5559959910388662739.jar 2023-09-13 03:00:25,252 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,253 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,253 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,253 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,254 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,254 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:25,254 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 03:00:25,255 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 03:00:25,255 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 03:00:25,256 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 03:00:25,256 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 03:00:25,256 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 03:00:25,257 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 03:00:25,257 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 03:00:25,257 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 03:00:25,258 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 03:00:25,258 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:25,259 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:25,259 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:25,260 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:25,260 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:25,260 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:25,261 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:25,591 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 03:00:25,594 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-13 03:00:25,596 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-13 03:00:28,784 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:28,785 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:28,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0003_000001 (auth:SIMPLE) 2023-09-13 03:00:29,727 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0004_000001 (auth:SIMPLE) 2023-09-13 03:00:33,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0004_000001 (auth:SIMPLE) 2023-09-13 03:00:35,396 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0004_000001 (auth:SIMPLE) 2023-09-13 03:00:37,471 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0004_000001 (auth:SIMPLE) 2023-09-13 03:00:38,757 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 03:00:38,757 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 03:00:38,760 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-13 03:00:38,760 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 03:00:38,760 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 03:00:38,760 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 03:00:38,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 03:00:38,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 03:00:38,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@50621125 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-13 03:00:38,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-13 03:00:38,764 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/local-export-1694574010765/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-13 03:00:38,776 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-13 03:00:38,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-09-13 03:00:38,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:38,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 03:00:38,780 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574038780"}]},"ts":"1694574038780"} 2023-09-13 03:00:38,782 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-13 03:00:38,784 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-13 03:00:38,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, UNASSIGN}] 2023-09-13 03:00:38,787 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, UNASSIGN 2023-09-13 03:00:38,787 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, UNASSIGN 2023-09-13 03:00:38,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5b3e2f50fbb4549fa89223153fefafe3, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:38,787 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=950ee9df5db4818e16e1c7e5330240ca, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:38,788 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574038787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574038787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574038787"}]},"ts":"1694574038787"} 2023-09-13 03:00:38,788 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574038787"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574038787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574038787"}]},"ts":"1694574038787"} 2023-09-13 03:00:38,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 5b3e2f50fbb4549fa89223153fefafe3, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:38,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 950ee9df5db4818e16e1c7e5330240ca, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:38,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 03:00:38,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:38,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5b3e2f50fbb4549fa89223153fefafe3, disabling compactions & flushes 2023-09-13 03:00:38,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:38,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 950ee9df5db4818e16e1c7e5330240ca, disabling compactions & flushes 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. after waiting 0 ms 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:38,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. after waiting 0 ms 2023-09-13 03:00:38,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:38,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:00:38,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:00:38,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:38,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:38,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca. 2023-09-13 03:00:38,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3. 2023-09-13 03:00:38,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 950ee9df5db4818e16e1c7e5330240ca: 2023-09-13 03:00:38,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5b3e2f50fbb4549fa89223153fefafe3: 2023-09-13 03:00:38,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:38,958 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=950ee9df5db4818e16e1c7e5330240ca, regionState=CLOSED 2023-09-13 03:00:38,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:38,958 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574038958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574038958"}]},"ts":"1694574038958"} 2023-09-13 03:00:38,958 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=5b3e2f50fbb4549fa89223153fefafe3, regionState=CLOSED 2023-09-13 03:00:38,958 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694574038958"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574038958"}]},"ts":"1694574038958"} 2023-09-13 03:00:38,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-13 03:00:38,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 950ee9df5db4818e16e1c7e5330240ca, server=jenkins-hbase9.apache.org,44723,1694573969468 in 169 msec 2023-09-13 03:00:38,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-13 03:00:38,962 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 5b3e2f50fbb4549fa89223153fefafe3, server=jenkins-hbase9.apache.org,45847,1694573969506 in 171 msec 2023-09-13 03:00:38,962 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=950ee9df5db4818e16e1c7e5330240ca, UNASSIGN in 176 msec 2023-09-13 03:00:38,963 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-13 03:00:38,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=5b3e2f50fbb4549fa89223153fefafe3, UNASSIGN in 177 msec 2023-09-13 03:00:38,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574038964"}]},"ts":"1694574038964"} 2023-09-13 03:00:38,965 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-13 03:00:38,967 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-13 03:00:38,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 190 msec 2023-09-13 03:00:39,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-13 03:00:39,082 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-13 03:00:39,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-09-13 03:00:39,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:39,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:39,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-13 03:00:39,087 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:39,089 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-13 03:00:39,093 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,093 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,093 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,093 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:39,093 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 03:00:39,093 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 03:00:39,093 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:39,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 03:00:39,094 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,095 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-13 03:00:39,096 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/recovered.edits] 2023-09-13 03:00:39,096 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/recovered.edits] 2023-09-13 03:00:39,101 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf/d2f1fc2fec8448229881d3ec73d1d255 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/cf/d2f1fc2fec8448229881d3ec73d1d255 2023-09-13 03:00:39,101 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf/f66e049eca254f4bacad425fe5d527a3 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/cf/f66e049eca254f4bacad425fe5d527a3 2023-09-13 03:00:39,104 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca/recovered.edits/9.seqid 2023-09-13 03:00:39,104 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3/recovered.edits/9.seqid 2023-09-13 03:00:39,104 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/950ee9df5db4818e16e1c7e5330240ca 2023-09-13 03:00:39,105 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testConsecutiveExports/5b3e2f50fbb4549fa89223153fefafe3 2023-09-13 03:00:39,105 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-13 03:00:39,105 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-13 03:00:39,106 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-13 03:00:39,109 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091389ece84286e849e18936e7a17012d641 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091389ece84286e849e18936e7a17012d641 2023-09-13 03:00:39,110 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913f02e588a9ca14133bc70cfdea5188773 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230913f02e588a9ca14133bc70cfdea5188773 2023-09-13 03:00:39,110 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-13 03:00:39,112 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:39,114 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-13 03:00:39,116 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-13 03:00:39,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:39,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-13 03:00:39,117 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574039117"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:39,117 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574039117"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:39,119 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 03:00:39,119 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 950ee9df5db4818e16e1c7e5330240ca, NAME => 'testtb-testConsecutiveExports,,1694574009644.950ee9df5db4818e16e1c7e5330240ca.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5b3e2f50fbb4549fa89223153fefafe3, NAME => 'testtb-testConsecutiveExports,1,1694574009644.5b3e2f50fbb4549fa89223153fefafe3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 03:00:39,119 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-13 03:00:39,119 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694574039119"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:39,120 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-13 03:00:39,123 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-13 03:00:39,124 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 40 msec 2023-09-13 03:00:39,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-13 03:00:39,197 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-13 03:00:39,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-13 03:00:39,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-13 03:00:39,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-09-13 03:00:39,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-13 03:00:39,233 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=753 (was 766), OpenFileDescriptor=909 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 192), ProcessCount=167 (was 167), AvailableMemoryMB=5876 (was 6025) 2023-09-13 03:00:39,233 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-13 03:00:39,250 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=753, OpenFileDescriptor=909, MaxFileDescriptor=60000, SystemLoadAverage=155, ProcessCount=167, AvailableMemoryMB=5875 2023-09-13 03:00:39,250 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-09-13 03:00:39,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 03:00:39,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,254 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 03:00:39,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-13 03:00:39,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 03:00:39,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 03:00:39,257 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,257 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,257 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 empty. 2023-09-13 03:00:39,257 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 empty. 2023-09-13 03:00:39,258 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,258 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,258 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-13 03:00:39,266 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-13 03:00:39,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c50c54e015f088cca2f03b7f3643fc96, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:39,268 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => f714feaedcdf32c99da9ccd4bbe67d52, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c50c54e015f088cca2f03b7f3643fc96, disabling compactions & flushes 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing f714feaedcdf32c99da9ccd4bbe67d52, disabling compactions & flushes 2023-09-13 03:00:39,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. after waiting 0 ms 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. after waiting 0 ms 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,283 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c50c54e015f088cca2f03b7f3643fc96: 2023-09-13 03:00:39,283 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for f714feaedcdf32c99da9ccd4bbe67d52: 2023-09-13 03:00:39,286 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 03:00:39,287 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574039286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574039286"}]},"ts":"1694574039286"} 2023-09-13 03:00:39,287 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574039286"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574039286"}]},"ts":"1694574039286"} 2023-09-13 03:00:39,292 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 03:00:39,293 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 03:00:39,293 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574039293"}]},"ts":"1694574039293"} 2023-09-13 03:00:39,294 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-13 03:00:39,299 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 03:00:39,299 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 03:00:39,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 03:00:39,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 03:00:39,300 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 03:00:39,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, ASSIGN}] 2023-09-13 03:00:39,302 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, ASSIGN 2023-09-13 03:00:39,302 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, ASSIGN 2023-09-13 03:00:39,302 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44723,1694573969468; forceNewPlan=false, retain=false 2023-09-13 03:00:39,303 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 03:00:39,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 03:00:39,453 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 03:00:39,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c50c54e015f088cca2f03b7f3643fc96, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,455 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f714feaedcdf32c99da9ccd4bbe67d52, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,455 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574039455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574039455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574039455"}]},"ts":"1694574039455"} 2023-09-13 03:00:39,455 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574039455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574039455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574039455"}]},"ts":"1694574039455"} 2023-09-13 03:00:39,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure c50c54e015f088cca2f03b7f3643fc96, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:39,458 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure f714feaedcdf32c99da9ccd4bbe67d52, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:39,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 03:00:39,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c50c54e015f088cca2f03b7f3643fc96, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 03:00:39,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f714feaedcdf32c99da9ccd4bbe67d52, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 03:00:39,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. service=AccessControlService 2023-09-13 03:00:39,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. service=AccessControlService 2023-09-13 03:00:39,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:39,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,617 INFO [StoreOpener-c50c54e015f088cca2f03b7f3643fc96-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,617 INFO [StoreOpener-f714feaedcdf32c99da9ccd4bbe67d52-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,618 DEBUG [StoreOpener-c50c54e015f088cca2f03b7f3643fc96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf 2023-09-13 03:00:39,619 DEBUG [StoreOpener-f714feaedcdf32c99da9ccd4bbe67d52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf 2023-09-13 03:00:39,619 DEBUG [StoreOpener-f714feaedcdf32c99da9ccd4bbe67d52-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf 2023-09-13 03:00:39,619 DEBUG [StoreOpener-c50c54e015f088cca2f03b7f3643fc96-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf 2023-09-13 03:00:39,619 INFO [StoreOpener-c50c54e015f088cca2f03b7f3643fc96-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c50c54e015f088cca2f03b7f3643fc96 columnFamilyName cf 2023-09-13 03:00:39,619 INFO [StoreOpener-f714feaedcdf32c99da9ccd4bbe67d52-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f714feaedcdf32c99da9ccd4bbe67d52 columnFamilyName cf 2023-09-13 03:00:39,621 INFO [StoreOpener-c50c54e015f088cca2f03b7f3643fc96-1] regionserver.HStore(310): Store=c50c54e015f088cca2f03b7f3643fc96/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:39,621 INFO [StoreOpener-f714feaedcdf32c99da9ccd4bbe67d52-1] regionserver.HStore(310): Store=f714feaedcdf32c99da9ccd4bbe67d52/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:39,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:39,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:39,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:39,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:39,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c50c54e015f088cca2f03b7f3643fc96; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67301071, jitterRate=0.0028641074895858765}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:39,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f714feaedcdf32c99da9ccd4bbe67d52; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58985544, jitterRate=-0.12104690074920654}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:39,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c50c54e015f088cca2f03b7f3643fc96: 2023-09-13 03:00:39,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f714feaedcdf32c99da9ccd4bbe67d52: 2023-09-13 03:00:39,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96., pid=60, masterSystemTime=1694574039609 2023-09-13 03:00:39,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52., pid=61, masterSystemTime=1694574039609 2023-09-13 03:00:39,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,629 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,629 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c50c54e015f088cca2f03b7f3643fc96, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,630 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574039629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574039629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574039629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574039629"}]},"ts":"1694574039629"} 2023-09-13 03:00:39,630 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=f714feaedcdf32c99da9ccd4bbe67d52, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,630 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574039630"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574039630"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574039630"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574039630"}]},"ts":"1694574039630"} 2023-09-13 03:00:39,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-13 03:00:39,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure c50c54e015f088cca2f03b7f3643fc96, server=jenkins-hbase9.apache.org,44723,1694573969468 in 174 msec 2023-09-13 03:00:39,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-13 03:00:39,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure f714feaedcdf32c99da9ccd4bbe67d52, server=jenkins-hbase9.apache.org,45847,1694573969506 in 174 msec 2023-09-13 03:00:39,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, ASSIGN in 333 msec 2023-09-13 03:00:39,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-13 03:00:39,636 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, ASSIGN in 334 msec 2023-09-13 03:00:39,636 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 03:00:39,636 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574039636"}]},"ts":"1694574039636"} 2023-09-13 03:00:39,637 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-13 03:00:39,640 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 03:00:39,640 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-13 03:00:39,641 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 03:00:39,643 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,643 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,643 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,643 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:39,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:39,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:39,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:39,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:39,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 392 msec 2023-09-13 03:00:39,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-13 03:00:39,858 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-13 03:00:39,860 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,860 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,862 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:00:39,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 03:00:39,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574039872 (current time:1694574039872). 2023-09-13 03:00:39,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:39,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x31b81e01 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:39,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35ba4feb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:39,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:39,886 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:39,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31b81e01 to 127.0.0.1:53387 2023-09-13 03:00:39,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:39,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x25ff71b1 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:39,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54463b19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:39,895 DEBUG [hconnection-0x3364e36d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:39,896 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:39,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:39,901 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25ff71b1 to 127.0.0.1:53387 2023-09-13 03:00:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:39,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 03:00:39,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:39,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 03:00:39,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 03:00:39,906 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 03:00:39,906 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694574639906 2023-09-13 03:00:39,906 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 03:00:39,907 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:39,908 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:39,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 03:00:39,908 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 03:00:39,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-13 03:00:39,910 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 03:00:39,911 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694574639911 2023-09-13 03:00:39,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,920 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-13 03:00:39,920 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:39,921 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-13 03:00:39,921 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-13 03:00:39,922 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,922 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,924 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:39,924 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:39,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:39,924 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:39,924 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:39,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:39,925 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,925 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,926 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 03:00:39,926 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 03:00:39,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,926 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 03:00:39,926 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:39,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,927 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 03:00:39,927 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 03:00:39,927 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:39,927 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 03:00:39,928 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 03:00:39,927 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:39,928 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 03:00:39,929 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 03:00:39,929 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 03:00:39,928 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 03:00:39,929 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 03:00:39,929 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 03:00:39,929 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 03:00:39,930 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,931 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,931 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,931 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:39,931 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,931 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:39,931 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,931 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:39,931 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:39,932 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,932 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:39,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:39,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:39,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 03:00:39,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae6f652[Count = 1] remaining members to acquire global barrier 2023-09-13 03:00:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:39,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:39,935 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 03:00:39,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae6f652[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:39,936 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-13 03:00:39,936 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 03:00:39,937 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 03:00:39,937 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:39,937 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,937 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. started... 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:39,938 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:39,937 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 03:00:39,938 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c50c54e015f088cca2f03b7f3643fc96: 2023-09-13 03:00:39,938 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:39,938 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. started... 2023-09-13 03:00:39,938 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,938 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:39,938 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,939 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f714feaedcdf32c99da9ccd4bbe67d52: 2023-09-13 03:00:39,939 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:39,939 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:00:39,939 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,939 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:39,939 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:00:39,946 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 03:00:39,946 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:39,946 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 03:00:39,956 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. completed. 2023-09-13 03:00:39,956 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:39,956 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. completed. 2023-09-13 03:00:39,956 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,956 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 03:00:39,957 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:39,958 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,958 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 03:00:39,958 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:39,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:39,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:39,958 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 03:00:39,960 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,960 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 03:00:39,960 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:39,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:39,960 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 03:00:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:39,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:39,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:00:39,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-13 03:00:39,967 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-13 03:00:39,967 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:39,967 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:39,967 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,967 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:39,969 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:39,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:39,970 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:39,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:39,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,971 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:39,971 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,974 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:39,975 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,975 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:39,979 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:39,979 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:39,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:39,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:39,980 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:39,980 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:39,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,980 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:39,981 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:00:39,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,981 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:39,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:39,982 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 03:00:39,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:39,996 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,008 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:40,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 03:00:40,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:00:40,009 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:00:40,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,027 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-13 03:00:40,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,028 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694574039906Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694574039995 (+89 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694574039995Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694574039996 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694574040005 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694574040021 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694574040027 (+6 ms) 2023-09-13 03:00:40,031 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 03:00:40,032 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 124 msec 2023-09-13 03:00:40,209 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:40,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 03:00:40,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:40,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44723] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:00:40,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:00:40,216 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,216 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:40,217 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:00:40,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 03:00:40,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574040226 (current time:1694574040226). 2023-09-13 03:00:40,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:40,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x3d728aee to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:40,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5be8176a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:40,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:40,236 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45530, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:40,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d728aee to 127.0.0.1:53387 2023-09-13 03:00:40,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:40,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x658e90c0 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:40,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c824365, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:40,243 DEBUG [hconnection-0x574a5ed8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:40,246 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:40,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:40,251 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x658e90c0 to 127.0.0.1:53387 2023-09-13 03:00:40,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:40,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-13 03:00:40,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:40,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 03:00:40,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 03:00:40,255 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 03:00:40,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-13 03:00:40,256 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,256 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694574640256 2023-09-13 03:00:40,257 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:40,257 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:40,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 03:00:40,258 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-13 03:00:40,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 4 msec 2023-09-13 03:00:40,260 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 03:00:40,260 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694574640260 2023-09-13 03:00:40,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,270 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-13 03:00:40,270 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:40,271 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-13 03:00:40,271 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-13 03:00:40,272 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,272 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,273 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:40,273 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:40,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:40,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:40,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:40,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:40,273 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:40,273 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:40,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:40,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,274 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,275 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,275 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 03:00:40,275 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,276 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 03:00:40,276 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 03:00:40,276 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:40,276 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-13 03:00:40,277 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 03:00:40,277 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 03:00:40,277 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:40,277 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 03:00:40,276 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:40,278 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 03:00:40,279 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-13 03:00:40,279 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 03:00:40,279 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 03:00:40,279 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-13 03:00:40,279 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-13 03:00:40,280 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,280 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:40,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,281 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,281 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:40,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59fab27b[Count = 1] remaining members to acquire global barrier 2023-09-13 03:00:40,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:40,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-13 03:00:40,284 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59fab27b[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:40,284 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-13 03:00:40,285 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 03:00:40,287 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 03:00:40,287 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:40,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,288 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 03:00:40,288 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-13 03:00:40,288 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,288 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:40,288 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:40,288 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:40,288 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:40,288 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:40,288 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:40,288 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. started... 2023-09-13 03:00:40,288 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:40,288 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. started... 2023-09-13 03:00:40,288 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c50c54e015f088cca2f03b7f3643fc96 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-13 03:00:40,288 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f714feaedcdf32c99da9ccd4bbe67d52 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-13 03:00:40,289 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 03:00:40,289 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:40,289 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 03:00:40,312 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309132cd054d97c254e9b955e5679ce6ecff7 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309132cd054d97c254e9b955e5679ce6ecff7 2023-09-13 03:00:40,316 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091302f10a14a5ba4f0a8f9351f71d6cadf3 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091302f10a14a5ba4f0a8f9351f71d6cadf3 2023-09-13 03:00:40,322 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/.tmp/cf/2cfda4a20eb1461b9c3ec0b0512f2e68 2023-09-13 03:00:40,328 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/.tmp/cf/fe3a711ee966453cb8a059f3e59c846a 2023-09-13 03:00:40,328 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/.tmp/cf/2cfda4a20eb1461b9c3ec0b0512f2e68 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf/2cfda4a20eb1461b9c3ec0b0512f2e68 2023-09-13 03:00:40,333 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/.tmp/cf/fe3a711ee966453cb8a059f3e59c846a as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf/fe3a711ee966453cb8a059f3e59c846a 2023-09-13 03:00:40,333 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf/2cfda4a20eb1461b9c3ec0b0512f2e68, entries=4, sequenceid=6, filesize=5.6 K 2023-09-13 03:00:40,334 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c50c54e015f088cca2f03b7f3643fc96 in 46ms, sequenceid=6, compaction requested=false 2023-09-13 03:00:40,335 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-13 03:00:40,335 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c50c54e015f088cca2f03b7f3643fc96: 2023-09-13 03:00:40,335 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,336 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:40,336 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf/2cfda4a20eb1461b9c3ec0b0512f2e68] hfiles 2023-09-13 03:00:40,336 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf/2cfda4a20eb1461b9c3ec0b0512f2e68 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,338 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf/fe3a711ee966453cb8a059f3e59c846a, entries=46, sequenceid=6, filesize=13.4 K 2023-09-13 03:00:40,340 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f714feaedcdf32c99da9ccd4bbe67d52 in 52ms, sequenceid=6, compaction requested=false 2023-09-13 03:00:40,341 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f714feaedcdf32c99da9ccd4bbe67d52: 2023-09-13 03:00:40,341 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,342 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:40,342 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf/fe3a711ee966453cb8a059f3e59c846a] hfiles 2023-09-13 03:00:40,342 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf/fe3a711ee966453cb8a059f3e59c846a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,344 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. completed. 2023-09-13 03:00:40,345 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:40,345 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:40,345 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:40,345 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,345 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 03:00:40,345 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:40,346 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,346 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 03:00:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:40,347 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:40,347 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 03:00:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:40,349 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. completed. 2023-09-13 03:00:40,349 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,349 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:40,349 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:40,349 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,349 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-13 03:00:40,349 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:40,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-13 03:00:40,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:40,351 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-13 03:00:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:00:40,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-13 03:00:40,357 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-13 03:00:40,357 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:40,357 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:40,357 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,357 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:40,357 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:40,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 03:00:40,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:00:40,358 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:40,362 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,362 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:40,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:40,363 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:40,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:40,363 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:40,365 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,365 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,365 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:40,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:40,368 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:40,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:40,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:40,368 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:40,369 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:40,370 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:40,368 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:40,370 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,370 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:40,370 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091302f10a14a5ba4f0a8f9351f71d6cadf3, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309132cd054d97c254e9b955e5679ce6ecff7] mob files 2023-09-13 03:00:40,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:40,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:40,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091302f10a14a5ba4f0a8f9351f71d6cadf3 2023-09-13 03:00:40,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309132cd054d97c254e9b955e5679ce6ecff7 2023-09-13 03:00:40,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,393 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-13 03:00:40,393 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,394 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:40,394 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694574040256Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694574040377 (+121 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694574040377Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694574040377Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694574040380 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694574040386 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694574040393 (+7 ms) 2023-09-13 03:00:40,396 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-13 03:00:40,397 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 139 msec 2023-09-13 03:00:40,558 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:40,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-13 03:00:40,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:40,586 DEBUG [Listener at jenkins-hbase9.apache.org/41229] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 03:00:40,589 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 03:00:40,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35085] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 03:00:40,590 DEBUG [Listener at jenkins-hbase9.apache.org/41229] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 03:00:40,593 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 03:00:40,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44723] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 03:00:40,593 DEBUG [Listener at jenkins-hbase9.apache.org/41229] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-13 03:00:40,599 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-13 03:00:40,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-13 03:00:40,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-13 03:00:40,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:40,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 03:00:40,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-13 03:00:40,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 03:00:40,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 03:00:40,606 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,606 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,607 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 empty. 2023-09-13 03:00:40,607 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 empty. 2023-09-13 03:00:40,607 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,607 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,607 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-13 03:00:40,618 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-13 03:00:40,619 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 990da5d364336476a558aacdbd6f5f93, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:40,619 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 640bbbd64806ec8b03f1c452ddc9faa6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:40,626 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:40,626 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 990da5d364336476a558aacdbd6f5f93, disabling compactions & flushes 2023-09-13 03:00:40,626 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,626 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. after waiting 0 ms 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 990da5d364336476a558aacdbd6f5f93: 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 640bbbd64806ec8b03f1c452ddc9faa6, disabling compactions & flushes 2023-09-13 03:00:40,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. after waiting 0 ms 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,627 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,627 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 640bbbd64806ec8b03f1c452ddc9faa6: 2023-09-13 03:00:40,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 03:00:40,630 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574040630"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574040630"}]},"ts":"1694574040630"} 2023-09-13 03:00:40,630 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574040630"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574040630"}]},"ts":"1694574040630"} 2023-09-13 03:00:40,632 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 03:00:40,632 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 03:00:40,632 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574040632"}]},"ts":"1694574040632"} 2023-09-13 03:00:40,633 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-13 03:00:40,636 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 03:00:40,637 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 03:00:40,637 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 03:00:40,637 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 03:00:40,637 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 03:00:40,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, ASSIGN}] 2023-09-13 03:00:40,639 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, ASSIGN 2023-09-13 03:00:40,639 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, ASSIGN 2023-09-13 03:00:40,640 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44723,1694573969468; forceNewPlan=false, retain=false 2023-09-13 03:00:40,640 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 03:00:40,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 03:00:40,790 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 03:00:40,793 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=640bbbd64806ec8b03f1c452ddc9faa6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,793 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=990da5d364336476a558aacdbd6f5f93, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,793 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574040793"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574040793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574040793"}]},"ts":"1694574040793"} 2023-09-13 03:00:40,793 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574040793"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574040793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574040793"}]},"ts":"1694574040793"} 2023-09-13 03:00:40,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 990da5d364336476a558aacdbd6f5f93, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:40,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 640bbbd64806ec8b03f1c452ddc9faa6, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:40,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 03:00:40,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 990da5d364336476a558aacdbd6f5f93, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.', STARTKEY => '', ENDKEY => '2'} 2023-09-13 03:00:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 640bbbd64806ec8b03f1c452ddc9faa6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.', STARTKEY => '2', ENDKEY => ''} 2023-09-13 03:00:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. service=AccessControlService 2023-09-13 03:00:40,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. service=AccessControlService 2023-09-13 03:00:40,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:40,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,951 INFO [StoreOpener-640bbbd64806ec8b03f1c452ddc9faa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,951 INFO [StoreOpener-990da5d364336476a558aacdbd6f5f93-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,953 DEBUG [StoreOpener-640bbbd64806ec8b03f1c452ddc9faa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf 2023-09-13 03:00:40,953 DEBUG [StoreOpener-640bbbd64806ec8b03f1c452ddc9faa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf 2023-09-13 03:00:40,953 DEBUG [StoreOpener-990da5d364336476a558aacdbd6f5f93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf 2023-09-13 03:00:40,953 DEBUG [StoreOpener-990da5d364336476a558aacdbd6f5f93-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf 2023-09-13 03:00:40,953 INFO [StoreOpener-990da5d364336476a558aacdbd6f5f93-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 990da5d364336476a558aacdbd6f5f93 columnFamilyName cf 2023-09-13 03:00:40,953 INFO [StoreOpener-640bbbd64806ec8b03f1c452ddc9faa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 640bbbd64806ec8b03f1c452ddc9faa6 columnFamilyName cf 2023-09-13 03:00:40,954 INFO [StoreOpener-990da5d364336476a558aacdbd6f5f93-1] regionserver.HStore(310): Store=990da5d364336476a558aacdbd6f5f93/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:40,954 INFO [StoreOpener-640bbbd64806ec8b03f1c452ddc9faa6-1] regionserver.HStore(310): Store=640bbbd64806ec8b03f1c452ddc9faa6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:40,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:40,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:40,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:40,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:40,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 640bbbd64806ec8b03f1c452ddc9faa6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62754740, jitterRate=-0.06488150358200073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:40,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 990da5d364336476a558aacdbd6f5f93; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66483931, jitterRate=-0.009312227368354797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:40,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 640bbbd64806ec8b03f1c452ddc9faa6: 2023-09-13 03:00:40,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 990da5d364336476a558aacdbd6f5f93: 2023-09-13 03:00:40,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93., pid=69, masterSystemTime=1694574040946 2023-09-13 03:00:40,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6., pid=70, masterSystemTime=1694574040946 2023-09-13 03:00:40,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:40,962 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=640bbbd64806ec8b03f1c452ddc9faa6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:40,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:40,962 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574040962"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574040962"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574040962"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574040962"}]},"ts":"1694574040962"} 2023-09-13 03:00:40,963 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=990da5d364336476a558aacdbd6f5f93, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:40,963 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574040963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574040963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574040963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574040963"}]},"ts":"1694574040963"} 2023-09-13 03:00:40,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-13 03:00:40,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 640bbbd64806ec8b03f1c452ddc9faa6, server=jenkins-hbase9.apache.org,45847,1694573969506 in 169 msec 2023-09-13 03:00:40,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-13 03:00:40,966 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 990da5d364336476a558aacdbd6f5f93, server=jenkins-hbase9.apache.org,44723,1694573969468 in 170 msec 2023-09-13 03:00:40,967 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, ASSIGN in 328 msec 2023-09-13 03:00:40,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-13 03:00:40,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, ASSIGN in 329 msec 2023-09-13 03:00:40,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 03:00:40,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574040968"}]},"ts":"1694574040968"} 2023-09-13 03:00:40,969 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-13 03:00:40,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 03:00:40,972 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-13 03:00:40,973 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-13 03:00:40,975 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:40,975 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:40,975 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:40,975 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:40,976 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,977 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:40,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 376 msec 2023-09-13 03:00:41,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-13 03:00:41,207 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-13 03:00:41,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions 990da5d364336476a558aacdbd6f5f93, 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:41,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[990da5d364336476a558aacdbd6f5f93, 640bbbd64806ec8b03f1c452ddc9faa6], force=true 2023-09-13 03:00:41,245 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[990da5d364336476a558aacdbd6f5f93, 640bbbd64806ec8b03f1c452ddc9faa6], force=true 2023-09-13 03:00:41,245 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[990da5d364336476a558aacdbd6f5f93, 640bbbd64806ec8b03f1c452ddc9faa6], force=true 2023-09-13 03:00:41,245 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[990da5d364336476a558aacdbd6f5f93, 640bbbd64806ec8b03f1c452ddc9faa6], force=true 2023-09-13 03:00:41,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 03:00:41,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, UNASSIGN}] 2023-09-13 03:00:41,268 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, UNASSIGN 2023-09-13 03:00:41,268 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, UNASSIGN 2023-09-13 03:00:41,269 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=990da5d364336476a558aacdbd6f5f93, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:41,269 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=640bbbd64806ec8b03f1c452ddc9faa6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:41,269 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574041269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574041269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574041269"}]},"ts":"1694574041269"} 2023-09-13 03:00:41,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574041269"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574041269"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574041269"}]},"ts":"1694574041269"} 2023-09-13 03:00:41,270 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 990da5d364336476a558aacdbd6f5f93, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:41,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 640bbbd64806ec8b03f1c452ddc9faa6, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:41,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 03:00:41,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:41,424 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 990da5d364336476a558aacdbd6f5f93, disabling compactions & flushes 2023-09-13 03:00:41,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:41,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:41,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. after waiting 0 ms 2023-09-13 03:00:41,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:41,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 990da5d364336476a558aacdbd6f5f93 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-13 03:00:41,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:41,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 640bbbd64806ec8b03f1c452ddc9faa6, disabling compactions & flushes 2023-09-13 03:00:41,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:41,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:41,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. after waiting 0 ms 2023-09-13 03:00:41,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:41,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 640bbbd64806ec8b03f1c452ddc9faa6 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-13 03:00:41,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/.tmp/cf/7fe58e412b5b46a4a2a1d08f6df359c3 2023-09-13 03:00:41,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/.tmp/cf/4cc6404c79c14239999abe13182abfa5 2023-09-13 03:00:41,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/.tmp/cf/4cc6404c79c14239999abe13182abfa5 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf/4cc6404c79c14239999abe13182abfa5 2023-09-13 03:00:41,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/.tmp/cf/7fe58e412b5b46a4a2a1d08f6df359c3 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf/7fe58e412b5b46a4a2a1d08f6df359c3 2023-09-13 03:00:41,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf/7fe58e412b5b46a4a2a1d08f6df359c3, entries=1, sequenceid=5, filesize=4.7 K 2023-09-13 03:00:41,459 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf/4cc6404c79c14239999abe13182abfa5, entries=1, sequenceid=5, filesize=4.7 K 2023-09-13 03:00:41,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 990da5d364336476a558aacdbd6f5f93 in 35ms, sequenceid=5, compaction requested=false 2023-09-13 03:00:41,460 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 640bbbd64806ec8b03f1c452ddc9faa6 in 34ms, sequenceid=5, compaction requested=false 2023-09-13 03:00:41,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 03:00:41,460 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 03:00:41,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-13 03:00:41,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-13 03:00:41,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:41,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93. 2023-09-13 03:00:41,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 990da5d364336476a558aacdbd6f5f93: 2023-09-13 03:00:41,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:41,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6. 2023-09-13 03:00:41,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 640bbbd64806ec8b03f1c452ddc9faa6: 2023-09-13 03:00:41,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:41,472 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=990da5d364336476a558aacdbd6f5f93, regionState=CLOSED 2023-09-13 03:00:41,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:41,472 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574041472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574041472"}]},"ts":"1694574041472"} 2023-09-13 03:00:41,473 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=640bbbd64806ec8b03f1c452ddc9faa6, regionState=CLOSED 2023-09-13 03:00:41,473 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694574041473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574041473"}]},"ts":"1694574041473"} 2023-09-13 03:00:41,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-13 03:00:41,475 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 990da5d364336476a558aacdbd6f5f93, server=jenkins-hbase9.apache.org,44723,1694573969468 in 204 msec 2023-09-13 03:00:41,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-13 03:00:41,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=990da5d364336476a558aacdbd6f5f93, UNASSIGN in 212 msec 2023-09-13 03:00:41,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 640bbbd64806ec8b03f1c452ddc9faa6, server=jenkins-hbase9.apache.org,45847,1694573969506 in 204 msec 2023-09-13 03:00:41,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=71 2023-09-13 03:00:41,478 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=640bbbd64806ec8b03f1c452ddc9faa6, UNASSIGN in 211 msec 2023-09-13 03:00:41,521 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-13 03:00:41,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040601.990da5d364336476a558aacdbd6f5f93.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:41,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694574040601.640bbbd64806ec8b03f1c452ddc9faa6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:41,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:41,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 03:00:41,568 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, ASSIGN}] 2023-09-13 03:00:41,568 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, ASSIGN 2023-09-13 03:00:41,569 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,44723,1694573969468; forceNewPlan=false, retain=false 2023-09-13 03:00:41,719 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-13 03:00:41,721 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4f8cf3b953addabbd611a69991900060, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:41,721 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694574041721"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574041721"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574041721"}]},"ts":"1694574041721"} 2023-09-13 03:00:41,723 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4f8cf3b953addabbd611a69991900060, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:41,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 03:00:41,876 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f8cf3b953addabbd611a69991900060, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.', STARTKEY => '', ENDKEY => ''} 2023-09-13 03:00:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. service=AccessControlService 2023-09-13 03:00:41,877 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,878 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/.regioninfo 2023-09-13 03:00:41,886 INFO [StoreOpener-4f8cf3b953addabbd611a69991900060-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,887 DEBUG [StoreOpener-4f8cf3b953addabbd611a69991900060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf 2023-09-13 03:00:41,887 DEBUG [StoreOpener-4f8cf3b953addabbd611a69991900060-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf 2023-09-13 03:00:41,887 INFO [StoreOpener-4f8cf3b953addabbd611a69991900060-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f8cf3b953addabbd611a69991900060 columnFamilyName cf 2023-09-13 03:00:41,913 DEBUG [StoreOpener-4f8cf3b953addabbd611a69991900060-1] regionserver.HStore(539): loaded hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/4cc6404c79c14239999abe13182abfa5.640bbbd64806ec8b03f1c452ddc9faa6->hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf/4cc6404c79c14239999abe13182abfa5-top 2023-09-13 03:00:41,918 DEBUG [StoreOpener-4f8cf3b953addabbd611a69991900060-1] regionserver.HStore(539): loaded hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/7fe58e412b5b46a4a2a1d08f6df359c3.990da5d364336476a558aacdbd6f5f93->hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf/7fe58e412b5b46a4a2a1d08f6df359c3-top 2023-09-13 03:00:41,918 INFO [StoreOpener-4f8cf3b953addabbd611a69991900060-1] regionserver.HStore(310): Store=4f8cf3b953addabbd611a69991900060/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:41,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,920 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:41,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4f8cf3b953addabbd611a69991900060; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72773433, jitterRate=0.08440865576267242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:41,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4f8cf3b953addabbd611a69991900060: 2023-09-13 03:00:41,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060., pid=77, masterSystemTime=1694574041874 2023-09-13 03:00:41,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.,because compaction is disabled. 2023-09-13 03:00:41,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:41,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:41,927 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4f8cf3b953addabbd611a69991900060, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:41,927 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694574041927"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574041927"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574041927"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574041927"}]},"ts":"1694574041927"} 2023-09-13 03:00:41,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-13 03:00:41,930 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4f8cf3b953addabbd611a69991900060, server=jenkins-hbase9.apache.org,44723,1694573969468 in 206 msec 2023-09-13 03:00:41,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-13 03:00:41,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, ASSIGN in 362 msec 2023-09-13 03:00:41,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[990da5d364336476a558aacdbd6f5f93, 640bbbd64806ec8b03f1c452ddc9faa6], force=true in 695 msec 2023-09-13 03:00:42,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-13 03:00:42,352 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-13 03:00:42,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 03:00:42,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574042353 (current time:1694574042353). 2023-09-13 03:00:42,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:42,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x69e23f22 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:42,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58145791, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:42,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:42,365 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:42,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69e23f22 to 127.0.0.1:53387 2023-09-13 03:00:42,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:42,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x2c101d92 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:42,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54733c1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:42,373 DEBUG [hconnection-0x2ea151dd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:42,375 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:42,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:42,382 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:42,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c101d92 to 127.0.0.1:53387 2023-09-13 03:00:42,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:42,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-13 03:00:42,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:42,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 03:00:42,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 03:00:42,386 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 03:00:42,387 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694574642387 2023-09-13 03:00:42,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-13 03:00:42,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,390 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:42,390 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:42,391 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-13 03:00:42,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 03:00:42,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 6 msec 2023-09-13 03:00:42,393 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 03:00:42,393 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694574642393 2023-09-13 03:00:42,403 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,403 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-13 03:00:42,403 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:42,404 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-13 03:00:42,404 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-13 03:00:42,404 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,404 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,406 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,406 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:42,406 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:42,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:42,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:42,407 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,407 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:42,406 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:42,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-13 03:00:42,408 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 03:00:42,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,408 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:42,408 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 03:00:42,408 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:42,409 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 03:00:42,409 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 03:00:42,410 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 03:00:42,410 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 03:00:42,410 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 03:00:42,409 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,410 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 03:00:42,410 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-13 03:00:42,410 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:42,411 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-13 03:00:42,411 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-13 03:00:42,411 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-13 03:00:42,412 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,412 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:42,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:42,413 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,414 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:42,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:42,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:42,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-13 03:00:42,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42546ad7[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:42,417 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-13 03:00:42,417 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 03:00:42,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 03:00:42,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,419 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:42,419 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 03:00:42,419 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. started... 2023-09-13 03:00:42,419 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:42,419 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:42,420 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f8cf3b953addabbd611a69991900060: 2023-09-13 03:00:42,421 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,421 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:42,421 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/4cc6404c79c14239999abe13182abfa5.640bbbd64806ec8b03f1c452ddc9faa6->hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf/4cc6404c79c14239999abe13182abfa5-top, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/7fe58e412b5b46a4a2a1d08f6df359c3.990da5d364336476a558aacdbd6f5f93->hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf/7fe58e412b5b46a4a2a1d08f6df359c3-top] hfiles 2023-09-13 03:00:42,421 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/4cc6404c79c14239999abe13182abfa5.640bbbd64806ec8b03f1c452ddc9faa6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,421 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/7fe58e412b5b46a4a2a1d08f6df359c3.990da5d364336476a558aacdbd6f5f93 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,422 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 03:00:42,422 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:42,422 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 03:00:42,423 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 03:00:42,423 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:42,423 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 03:00:42,434 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. completed. 2023-09-13 03:00:42,434 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:42,434 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:42,434 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:42,434 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,434 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-13 03:00:42,434 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:42,440 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,440 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-13 03:00:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:42,440 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:42,440 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-13 03:00:42,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:00:42,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-13 03:00:42,443 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-13 03:00:42,443 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:42,443 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:42,444 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,444 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:42,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:42,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,446 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:42,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:42,446 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,446 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:42,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:42,446 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,447 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:42,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,449 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:42,449 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,449 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:42,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:42,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:42,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,452 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,452 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:42,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:42,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:42,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:42,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:42,453 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:42,454 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:42,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,454 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,454 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:42,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:42,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-13 03:00:42,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,476 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694574042387Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694574042453 (+66 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694574042453Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694574042456 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694574042467 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694574042476 (+9 ms) 2023-09-13 03:00:42,479 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-13 03:00:42,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 89 msec 2023-09-13 03:00:42,490 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:42,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-13 03:00:42,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:42,491 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491 2023-09-13 03:00:42,491 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34433, tgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491, rawTgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:42,514 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:42,514 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_355581089_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,514 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-13 03:00:42,522 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:42,540 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:42,540 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:42,541 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:42,541 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,421 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-1851731534729678484.jar 2023-09-13 03:00:43,422 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,422 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,486 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-6508446851486433411.jar 2023-09-13 03:00:43,486 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,487 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,487 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,487 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,488 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,488 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:43,489 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 03:00:43,490 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 03:00:43,490 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 03:00:43,490 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 03:00:43,491 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 03:00:43,491 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 03:00:43,491 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 03:00:43,492 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 03:00:43,492 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 03:00:43,492 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 03:00:43,493 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:43,493 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:43,494 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:43,494 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:43,494 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:43,495 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:43,495 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:43,654 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0004_000001 (auth:SIMPLE) 2023-09-13 03:00:43,834 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 03:00:43,836 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-13 03:00:43,838 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-13 03:00:43,888 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:43,888 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:44,528 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 03:00:44,658 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0005_000001 (auth:SIMPLE) 2023-09-13 03:00:48,093 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0005_000001 (auth:SIMPLE) 2023-09-13 03:00:50,295 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0005_000001 (auth:SIMPLE) 2023-09-13 03:00:52,543 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0005_000001 (auth:SIMPLE) 2023-09-13 03:00:53,986 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 03:00:53,989 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 03:00:53,996 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:53,996 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 03:00:53,997 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 03:00:53,997 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:53,997 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-13 03:00:53,997 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-13 03:00:53,997 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:53,998 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-13 03:00:53,998 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574042491/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-13 03:00:54,003 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 03:00:54,008 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574054008"}]},"ts":"1694574054008"} 2023-09-13 03:00:54,009 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-13 03:00:54,011 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-13 03:00:54,012 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, UNASSIGN}] 2023-09-13 03:00:54,013 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, UNASSIGN 2023-09-13 03:00:54,014 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4f8cf3b953addabbd611a69991900060, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:54,014 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694574054014"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574054014"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574054014"}]},"ts":"1694574054014"} 2023-09-13 03:00:54,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4f8cf3b953addabbd611a69991900060, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:54,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 03:00:54,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4f8cf3b953addabbd611a69991900060, disabling compactions & flushes 2023-09-13 03:00:54,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. after waiting 0 ms 2023-09-13 03:00:54,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:54,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-13 03:00:54,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:54,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060. 2023-09-13 03:00:54,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4f8cf3b953addabbd611a69991900060: 2023-09-13 03:00:54,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:54,180 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4f8cf3b953addabbd611a69991900060, regionState=CLOSED 2023-09-13 03:00:54,180 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694574054180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574054180"}]},"ts":"1694574054180"} 2023-09-13 03:00:54,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-13 03:00:54,183 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4f8cf3b953addabbd611a69991900060, server=jenkins-hbase9.apache.org,44723,1694573969468 in 167 msec 2023-09-13 03:00:54,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-13 03:00:54,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4f8cf3b953addabbd611a69991900060, UNASSIGN in 171 msec 2023-09-13 03:00:54,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574054185"}]},"ts":"1694574054185"} 2023-09-13 03:00:54,186 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-13 03:00:54,189 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-13 03:00:54,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 186 msec 2023-09-13 03:00:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-13 03:00:54,309 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-13 03:00:54,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,313 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,314 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,315 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,318 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,318 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,318 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,318 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:54,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:54,318 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,318 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:54,318 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 03:00:54,318 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-13 03:00:54,319 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,319 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,319 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-13 03:00:54,320 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 03:00:54,319 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-13 03:00:54,320 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-13 03:00:54,319 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,319 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,320 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:54,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-13 03:00:54,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:54,321 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/recovered.edits] 2023-09-13 03:00:54,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:54,321 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/recovered.edits] 2023-09-13 03:00:54,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:54,321 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/recovered.edits] 2023-09-13 03:00:54,325 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf/4cc6404c79c14239999abe13182abfa5 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/cf/4cc6404c79c14239999abe13182abfa5 2023-09-13 03:00:54,326 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/4cc6404c79c14239999abe13182abfa5.640bbbd64806ec8b03f1c452ddc9faa6 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/4cc6404c79c14239999abe13182abfa5.640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:54,326 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf/7fe58e412b5b46a4a2a1d08f6df359c3 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/cf/7fe58e412b5b46a4a2a1d08f6df359c3 2023-09-13 03:00:54,327 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/7fe58e412b5b46a4a2a1d08f6df359c3.990da5d364336476a558aacdbd6f5f93 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/cf/7fe58e412b5b46a4a2a1d08f6df359c3.990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:54,329 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/recovered.edits/8.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93/recovered.edits/8.seqid 2023-09-13 03:00:54,329 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/recovered.edits/8.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6/recovered.edits/8.seqid 2023-09-13 03:00:54,330 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/640bbbd64806ec8b03f1c452ddc9faa6 2023-09-13 03:00:54,330 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/990da5d364336476a558aacdbd6f5f93 2023-09-13 03:00:54,331 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/recovered.edits/12.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060/recovered.edits/12.seqid 2023-09-13 03:00:54,332 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4f8cf3b953addabbd611a69991900060 2023-09-13 03:00:54,332 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-13 03:00:54,334 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,336 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-13 03:00:54,337 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-13 03:00:54,338 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,338 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-13 03:00:54,338 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574054338"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:54,340 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-13 03:00:54,340 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4f8cf3b953addabbd611a69991900060, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694574040602.4f8cf3b953addabbd611a69991900060.', STARTKEY => '', ENDKEY => ''}] 2023-09-13 03:00:54,340 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-13 03:00:54,340 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694574054340"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:54,341 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-13 03:00:54,344 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-13 03:00:54,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-13 03:00:54,422 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-13 03:00:54,422 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 03:00:54,426 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574054426"}]},"ts":"1694574054426"} 2023-09-13 03:00:54,427 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-13 03:00:54,429 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-13 03:00:54,429 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, UNASSIGN}] 2023-09-13 03:00:54,431 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, UNASSIGN 2023-09-13 03:00:54,431 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, UNASSIGN 2023-09-13 03:00:54,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f714feaedcdf32c99da9ccd4bbe67d52, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:54,432 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c50c54e015f088cca2f03b7f3643fc96, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:54,432 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574054432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574054432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574054432"}]},"ts":"1694574054432"} 2023-09-13 03:00:54,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574054432"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574054432"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574054432"}]},"ts":"1694574054432"} 2023-09-13 03:00:54,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure c50c54e015f088cca2f03b7f3643fc96, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:00:54,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure f714feaedcdf32c99da9ccd4bbe67d52, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:54,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 03:00:54,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:54,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c50c54e015f088cca2f03b7f3643fc96, disabling compactions & flushes 2023-09-13 03:00:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f714feaedcdf32c99da9ccd4bbe67d52, disabling compactions & flushes 2023-09-13 03:00:54,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:54,585 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. after waiting 0 ms 2023-09-13 03:00:54,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:54,585 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. after waiting 0 ms 2023-09-13 03:00:54,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:54,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:00:54,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:00:54,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:54,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:00:54,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96. 2023-09-13 03:00:54,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52. 2023-09-13 03:00:54,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f714feaedcdf32c99da9ccd4bbe67d52: 2023-09-13 03:00:54,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c50c54e015f088cca2f03b7f3643fc96: 2023-09-13 03:00:54,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:54,599 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c50c54e015f088cca2f03b7f3643fc96, regionState=CLOSED 2023-09-13 03:00:54,600 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574054599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574054599"}]},"ts":"1694574054599"} 2023-09-13 03:00:54,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:54,600 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=f714feaedcdf32c99da9ccd4bbe67d52, regionState=CLOSED 2023-09-13 03:00:54,600 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694574054600"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574054600"}]},"ts":"1694574054600"} 2023-09-13 03:00:54,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-13 03:00:54,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure c50c54e015f088cca2f03b7f3643fc96, server=jenkins-hbase9.apache.org,44723,1694573969468 in 168 msec 2023-09-13 03:00:54,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-13 03:00:54,603 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure f714feaedcdf32c99da9ccd4bbe67d52, server=jenkins-hbase9.apache.org,45847,1694573969506 in 168 msec 2023-09-13 03:00:54,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c50c54e015f088cca2f03b7f3643fc96, UNASSIGN in 174 msec 2023-09-13 03:00:54,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-13 03:00:54,604 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f714feaedcdf32c99da9ccd4bbe67d52, UNASSIGN in 174 msec 2023-09-13 03:00:54,605 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574054605"}]},"ts":"1694574054605"} 2023-09-13 03:00:54,606 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-13 03:00:54,607 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-13 03:00:54,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 185 msec 2023-09-13 03:00:54,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-13 03:00:54,728 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-13 03:00:54,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,731 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,732 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,735 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:54,735 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:54,735 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,736 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,736 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,736 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 03:00:54,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 03:00:54,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 03:00:54,736 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-13 03:00:54,737 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/recovered.edits] 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,737 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/recovered.edits] 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,737 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:54,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-13 03:00:54,741 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf/2cfda4a20eb1461b9c3ec0b0512f2e68 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/cf/2cfda4a20eb1461b9c3ec0b0512f2e68 2023-09-13 03:00:54,741 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf/fe3a711ee966453cb8a059f3e59c846a to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/cf/fe3a711ee966453cb8a059f3e59c846a 2023-09-13 03:00:54,744 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96/recovered.edits/9.seqid 2023-09-13 03:00:54,744 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52/recovered.edits/9.seqid 2023-09-13 03:00:54,745 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c50c54e015f088cca2f03b7f3643fc96 2023-09-13 03:00:54,745 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f714feaedcdf32c99da9ccd4bbe67d52 2023-09-13 03:00:54,745 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-13 03:00:54,745 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-13 03:00:54,746 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-13 03:00:54,749 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091302f10a14a5ba4f0a8f9351f71d6cadf3 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b2023091302f10a14a5ba4f0a8f9351f71d6cadf3 2023-09-13 03:00:54,750 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309132cd054d97c254e9b955e5679ce6ecff7 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202309132cd054d97c254e9b955e5679ce6ecff7 2023-09-13 03:00:54,750 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-13 03:00:54,752 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,754 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-13 03:00:54,755 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-13 03:00:54,756 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,756 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-13 03:00:54,756 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574054756"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:54,756 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574054756"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:54,757 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 03:00:54,757 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c50c54e015f088cca2f03b7f3643fc96, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694574039251.c50c54e015f088cca2f03b7f3643fc96.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f714feaedcdf32c99da9ccd4bbe67d52, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694574039251.f714feaedcdf32c99da9ccd4bbe67d52.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 03:00:54,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-13 03:00:54,757 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694574054757"}]},"ts":"9223372036854775807"} 2023-09-13 03:00:54,759 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-13 03:00:54,760 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,761 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 32 msec 2023-09-13 03:00:54,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-13 03:00:54,839 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-13 03:00:54,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-13 03:00:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-13 03:00:54,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-13 03:00:54,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-13 03:00:54,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-13 03:00:54,876 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 753) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-707642729_1 at /127.0.0.1:42172 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:40440 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:48632 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-707642729_1 at /127.0.0.1:40412 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3834 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:39533 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 909) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=124 (was 155), ProcessCount=168 (was 167) - ProcessCount LEAK? -, AvailableMemoryMB=5777 (was 5875) 2023-09-13 03:00:54,876 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-13 03:00:54,894 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=912, MaxFileDescriptor=60000, SystemLoadAverage=124, ProcessCount=168, AvailableMemoryMB=5776 2023-09-13 03:00:54,894 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-13 03:00:54,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 03:00:54,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:00:54,898 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 03:00:54,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-13 03:00:54,899 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 03:00:54,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 03:00:54,901 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:54,901 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:54,901 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 empty. 2023-09-13 03:00:54,901 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae empty. 2023-09-13 03:00:54,902 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:54,902 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:54,902 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-13 03:00:54,910 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-13 03:00:54,911 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2ac58e8416eec79930bb895dabf137ae, NAME => 'testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:54,911 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 154759cba1cf7f58c9414efb50b4d048, NAME => 'testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:00:54,928 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:54,929 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 154759cba1cf7f58c9414efb50b4d048, disabling compactions & flushes 2023-09-13 03:00:54,929 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:54,929 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:54,929 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. after waiting 0 ms 2023-09-13 03:00:54,929 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:54,929 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:54,929 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 154759cba1cf7f58c9414efb50b4d048: 2023-09-13 03:00:54,930 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:54,930 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 2ac58e8416eec79930bb895dabf137ae, disabling compactions & flushes 2023-09-13 03:00:54,930 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:54,930 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:54,930 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. after waiting 0 ms 2023-09-13 03:00:54,930 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:54,930 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:54,930 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 2ac58e8416eec79930bb895dabf137ae: 2023-09-13 03:00:54,932 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 03:00:54,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574054933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574054933"}]},"ts":"1694574054933"} 2023-09-13 03:00:54,933 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574054933"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574054933"}]},"ts":"1694574054933"} 2023-09-13 03:00:54,935 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 03:00:54,936 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 03:00:54,936 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574054936"}]},"ts":"1694574054936"} 2023-09-13 03:00:54,938 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-13 03:00:54,942 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 03:00:54,943 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 03:00:54,943 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 03:00:54,943 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 03:00:54,943 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 03:00:54,944 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, ASSIGN}] 2023-09-13 03:00:54,946 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, ASSIGN 2023-09-13 03:00:54,946 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, ASSIGN 2023-09-13 03:00:54,946 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35085,1694573969420; forceNewPlan=false, retain=false 2023-09-13 03:00:54,946 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 03:00:55,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 03:00:55,097 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 03:00:55,099 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=154759cba1cf7f58c9414efb50b4d048, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,099 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2ac58e8416eec79930bb895dabf137ae, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,100 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574055099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574055099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574055099"}]},"ts":"1694574055099"} 2023-09-13 03:00:55,100 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574055099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574055099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574055099"}]},"ts":"1694574055099"} 2023-09-13 03:00:55,101 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 154759cba1cf7f58c9414efb50b4d048, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:00:55,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 2ac58e8416eec79930bb895dabf137ae, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 03:00:55,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 03:00:55,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 154759cba1cf7f58c9414efb50b4d048, NAME => 'testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ac58e8416eec79930bb895dabf137ae, NAME => 'testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. service=AccessControlService 2023-09-13 03:00:55,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. service=AccessControlService 2023-09-13 03:00:55,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:00:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:00:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,261 INFO [StoreOpener-154759cba1cf7f58c9414efb50b4d048-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,261 INFO [StoreOpener-2ac58e8416eec79930bb895dabf137ae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,262 DEBUG [StoreOpener-154759cba1cf7f58c9414efb50b4d048-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf 2023-09-13 03:00:55,262 DEBUG [StoreOpener-2ac58e8416eec79930bb895dabf137ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf 2023-09-13 03:00:55,263 DEBUG [StoreOpener-2ac58e8416eec79930bb895dabf137ae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf 2023-09-13 03:00:55,262 DEBUG [StoreOpener-154759cba1cf7f58c9414efb50b4d048-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf 2023-09-13 03:00:55,263 INFO [StoreOpener-2ac58e8416eec79930bb895dabf137ae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac58e8416eec79930bb895dabf137ae columnFamilyName cf 2023-09-13 03:00:55,263 INFO [StoreOpener-154759cba1cf7f58c9414efb50b4d048-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 154759cba1cf7f58c9414efb50b4d048 columnFamilyName cf 2023-09-13 03:00:55,264 INFO [StoreOpener-154759cba1cf7f58c9414efb50b4d048-1] regionserver.HStore(310): Store=154759cba1cf7f58c9414efb50b4d048/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:55,265 INFO [StoreOpener-2ac58e8416eec79930bb895dabf137ae-1] regionserver.HStore(310): Store=2ac58e8416eec79930bb895dabf137ae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:00:55,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:00:55,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:00:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:55,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 154759cba1cf7f58c9414efb50b4d048; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67785485, jitterRate=0.010082438588142395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:00:55,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 154759cba1cf7f58c9414efb50b4d048: 2023-09-13 03:00:55,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2ac58e8416eec79930bb895dabf137ae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68285148, jitterRate=0.017527997493743896}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:00:55,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2ac58e8416eec79930bb895dabf137ae: 2023-09-13 03:00:55,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048., pid=93, masterSystemTime=1694574055253 2023-09-13 03:00:55,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae., pid=94, masterSystemTime=1694574055253 2023-09-13 03:00:55,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,273 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=154759cba1cf7f58c9414efb50b4d048, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,273 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574055273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574055273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574055273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574055273"}]},"ts":"1694574055273"} 2023-09-13 03:00:55,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,274 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2ac58e8416eec79930bb895dabf137ae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,274 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574055274"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574055274"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574055274"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574055274"}]},"ts":"1694574055274"} 2023-09-13 03:00:55,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-13 03:00:55,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 154759cba1cf7f58c9414efb50b4d048, server=jenkins-hbase9.apache.org,45847,1694573969506 in 174 msec 2023-09-13 03:00:55,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-13 03:00:55,277 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 2ac58e8416eec79930bb895dabf137ae, server=jenkins-hbase9.apache.org,35085,1694573969420 in 173 msec 2023-09-13 03:00:55,277 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, ASSIGN in 333 msec 2023-09-13 03:00:55,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-13 03:00:55,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, ASSIGN in 334 msec 2023-09-13 03:00:55,279 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 03:00:55,279 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574055279"}]},"ts":"1694574055279"} 2023-09-13 03:00:55,280 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-13 03:00:55,282 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 03:00:55,282 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-13 03:00:55,283 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 03:00:55,285 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:55,285 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:55,285 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:55,285 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:00:55,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:55,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:55,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:55,286 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-13 03:00:55,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 390 msec 2023-09-13 03:00:55,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-13 03:00:55,502 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-13 03:00:55,504 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-13 03:00:55,504 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,506 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:00:55,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 03:00:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574055516 (current time:1694574055516). 2023-09-13 03:00:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:55,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x3ad69415 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:55,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19e31299, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:55,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:55,527 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:55,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ad69415 to 127.0.0.1:53387 2023-09-13 03:00:55,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:55,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x02ad18c2 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:55,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cd542be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:55,534 DEBUG [hconnection-0xd23fe67-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:55,536 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54676, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:55,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:55,541 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:55,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02ad18c2 to 127.0.0.1:53387 2023-09-13 03:00:55,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:55,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 03:00:55,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:55,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 03:00:55,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 03:00:55,545 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 03:00:55,546 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694574655546 2023-09-13 03:00:55,546 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-13 03:00:55,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 03:00:55,547 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:55,547 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:55,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 03:00:55,548 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 03:00:55,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-13 03:00:55,553 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 03:00:55,553 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694574655553 2023-09-13 03:00:55,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,564 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-13 03:00:55,564 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,565 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-13 03:00:55,565 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-13 03:00:55,565 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,565 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,572 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,572 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,572 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,572 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,572 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,572 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,573 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 03:00:55,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 03:00:55,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,574 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 03:00:55,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,574 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 03:00:55,574 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 03:00:55,574 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,574 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,575 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 03:00:55,576 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 03:00:55,576 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 03:00:55,576 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 03:00:55,574 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,576 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 03:00:55,577 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 03:00:55,577 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 03:00:55,577 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 03:00:55,577 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 03:00:55,579 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,579 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,579 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,579 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,580 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,580 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:55,580 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,584 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,584 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:55,584 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,584 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e740ff7[Count = 1] remaining members to acquire global barrier 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 03:00:55,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e740ff7[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:55,588 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 03:00:55,588 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,589 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 03:00:55,589 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 03:00:55,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,589 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:55,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,590 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,590 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 03:00:55,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,590 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:55,590 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 03:00:55,590 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:55,590 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:55,590 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,590 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:55,590 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:55,590 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,590 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. started... 2023-09-13 03:00:55,590 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. started... 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 154759cba1cf7f58c9414efb50b4d048: 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ac58e8416eec79930bb895dabf137ae: 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:00:55,591 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:00:55,592 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 03:00:55,592 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,592 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 03:00:55,603 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. completed. 2023-09-13 03:00:55,603 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:55,603 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. completed. 2023-09-13 03:00:55,603 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 03:00:55,603 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:55,605 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 03:00:55,605 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 03:00:55,605 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,605 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,605 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,605 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,605 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 03:00:55,606 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 03:00:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,35085,1694573969420': 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:00:55,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 03:00:55,612 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-13 03:00:55,612 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:55,612 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:55,612 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,612 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:55,613 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,613 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,613 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:55,613 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:55,613 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,613 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,614 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,614 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:55,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:55,614 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,615 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,617 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,617 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,617 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,620 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,620 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:55,621 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-13 03:00:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:55,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,620 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:55,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:00:55,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:55,621 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:55,622 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,622 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,622 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,622 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 03:00:55,628 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,647 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:55,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 03:00:55,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:00:55,649 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:00:55,649 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-13 03:00:55,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,649 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694574055546Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694574055628 (+82 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694574055628Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694574055628Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694574055632 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694574055643 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694574055649 (+6 ms) 2023-09-13 03:00:55,652 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 03:00:55,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 105 msec 2023-09-13 03:00:55,849 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:55,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 03:00:55,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:55,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35085] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:00:55,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:00:55,855 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-13 03:00:55,855 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,855 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:00:55,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 03:00:55,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574055864 (current time:1694574055864). 2023-09-13 03:00:55,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:00:55,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x60bbb10c to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:55,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7279bbba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:55,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:55,878 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:55,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60bbb10c to 127.0.0.1:53387 2023-09-13 03:00:55,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:55,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x132bff3a to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:00:55,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e251f82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:00:55,886 DEBUG [hconnection-0x11bed597-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:55,887 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:54688, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:55,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:00:55,890 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52402, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:00:55,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x132bff3a to 127.0.0.1:53387 2023-09-13 03:00:55,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:00:55,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-13 03:00:55,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:00:55,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 03:00:55,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 03:00:55,895 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 03:00:55,895 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694574655895 2023-09-13 03:00:55,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-13 03:00:55,895 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-13 03:00:55,896 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:00:55,896 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:00:55,897 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-13 03:00:55,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 03:00:55,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-13 03:00:55,899 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 03:00:55,899 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694574655899 2023-09-13 03:00:55,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,907 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-13 03:00:55,907 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,908 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-13 03:00:55,908 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-13 03:00:55,908 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,908 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,910 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,910 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,910 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:55,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:55,910 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,911 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,911 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,911 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,911 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:00:55,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-13 03:00:55,912 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,912 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,912 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 03:00:55,912 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,913 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 03:00:55,914 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 03:00:55,912 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,914 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 03:00:55,914 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-13 03:00:55,914 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:00:55,914 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 03:00:55,917 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-13 03:00:55,917 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 03:00:55,917 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 03:00:55,917 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-13 03:00:55,917 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-13 03:00:55,918 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,918 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,919 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,919 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,919 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,919 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:55,919 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,920 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,920 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:55,920 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,920 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:00:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23ad380d[Count = 1] remaining members to acquire global barrier 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-13 03:00:55,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23ad380d[Count = 0] remaining members to acquire global barrier 2023-09-13 03:00:55,923 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-13 03:00:55,923 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 03:00:55,928 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,928 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:55,928 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,928 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. started... 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 03:00:55,928 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,928 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:55,928 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2ac58e8416eec79930bb895dabf137ae 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-13 03:00:55,928 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-13 03:00:55,928 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. started... 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 03:00:55,928 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:00:55,929 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:00:55,929 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:00:55,929 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 154759cba1cf7f58c9414efb50b4d048 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-13 03:00:55,930 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 03:00:55,930 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,930 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 03:00:55,953 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230913ab9ea38b07d743ed900f9635f1018d25 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913ab9ea38b07d743ed900f9635f1018d25 2023-09-13 03:00:55,957 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230913688e1d9225554346bddd11f69614ab6e to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913688e1d9225554346bddd11f69614ab6e 2023-09-13 03:00:55,961 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/.tmp/cf/f237d3c942c24a92a09039fe84b908cf 2023-09-13 03:00:55,966 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/.tmp/cf/f237d3c942c24a92a09039fe84b908cf as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf/f237d3c942c24a92a09039fe84b908cf 2023-09-13 03:00:55,969 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/.tmp/cf/469de3bd43ca4d25b3de7dc41c91aad8 2023-09-13 03:00:55,972 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf/f237d3c942c24a92a09039fe84b908cf, entries=4, sequenceid=6, filesize=5.6 K 2023-09-13 03:00:55,973 INFO [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 2ac58e8416eec79930bb895dabf137ae in 45ms, sequenceid=6, compaction requested=false 2023-09-13 03:00:55,973 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-13 03:00:55,973 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/.tmp/cf/469de3bd43ca4d25b3de7dc41c91aad8 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf/469de3bd43ca4d25b3de7dc41c91aad8 2023-09-13 03:00:55,974 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ac58e8416eec79930bb895dabf137ae: 2023-09-13 03:00:55,974 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,974 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:55,974 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf/f237d3c942c24a92a09039fe84b908cf] hfiles 2023-09-13 03:00:55,974 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf/f237d3c942c24a92a09039fe84b908cf for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,978 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf/469de3bd43ca4d25b3de7dc41c91aad8, entries=46, sequenceid=6, filesize=12.9 K 2023-09-13 03:00:55,979 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 154759cba1cf7f58c9414efb50b4d048 in 50ms, sequenceid=6, compaction requested=false 2023-09-13 03:00:55,981 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 154759cba1cf7f58c9414efb50b4d048: 2023-09-13 03:00:55,983 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,983 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:00:55,983 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf/469de3bd43ca4d25b3de7dc41c91aad8] hfiles 2023-09-13 03:00:55,983 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf/469de3bd43ca4d25b3de7dc41c91aad8 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,985 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. completed. 2023-09-13 03:00:55,985 DEBUG [rs(jenkins-hbase9.apache.org,35085,1694573969420)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:00:55,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:55,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:55,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 03:00:55,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:00:55,988 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,988 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 03:00:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,988 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,988 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 03:00:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:55,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,35085,1694573969420': 2023-09-13 03:00:55,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-13 03:00:55,995 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. completed. 2023-09-13 03:00:55,995 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:00:55,995 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:00:55,995 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:00:55,995 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,995 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-13 03:00:55,995 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:00:55,997 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,997 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:55,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:55,997 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-13 03:00:55,997 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:55,997 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-13 03:00:55,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:55,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 03:00:55,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:00:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:55,999 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:00:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:55,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:00:56,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-13 03:00:56,001 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-13 03:00:56,001 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:00:56,001 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:00:56,001 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,001 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:00:56,004 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,004 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,004 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:56,004 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:56,004 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,004 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:00:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:00:56,005 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:56,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:56,006 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:00:56,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,007 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,007 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:00:56,008 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,010 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,010 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,010 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:56,010 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:56,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:56,011 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:56,011 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:00:56,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:56,011 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:56,010 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,010 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:00:56,012 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-13 03:00:56,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:00:56,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:00:56,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:00:56,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:56,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:00:56,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:56,012 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:00:56,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:00:56,013 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,013 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913688e1d9225554346bddd11f69614ab6e, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913ab9ea38b07d743ed900f9635f1018d25] mob files 2023-09-13 03:00:56,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913688e1d9225554346bddd11f69614ab6e 2023-09-13 03:00:56,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913ab9ea38b07d743ed900f9635f1018d25 2023-09-13 03:00:56,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,019 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,035 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-13 03:00:56,035 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,036 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694574055895Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694574056019 (+124 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694574056019Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694574056019Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694574056023 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694574056029 (+6 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694574056035 (+6 ms) 2023-09-13 03:00:56,038 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-13 03:00:56,039 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 142 msec 2023-09-13 03:00:56,199 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:00:56,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-13 03:00:56,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:00:56,200 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200 2023-09-13 03:00:56,200 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34433, tgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200, rawTgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:56,221 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:00:56,221 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-254044778_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,221 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-13 03:00:56,226 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:00:56,241 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:56,241 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:56,242 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:56,242 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,080 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-16777769144495850.jar 2023-09-13 03:00:57,081 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,081 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,145 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-2322671352328044270.jar 2023-09-13 03:00:57,145 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,145 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,146 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,146 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,146 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,147 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 03:00:57,147 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 03:00:57,147 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 03:00:57,148 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 03:00:57,148 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 03:00:57,148 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 03:00:57,149 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 03:00:57,149 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 03:00:57,149 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 03:00:57,150 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 03:00:57,150 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 03:00:57,151 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:57,151 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:57,151 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:57,152 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:57,152 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:00:57,152 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:57,153 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:00:57,480 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 03:00:57,482 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-13 03:00:58,711 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:58,711 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:00:58,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0005_000001 (auth:SIMPLE) 2023-09-13 03:00:58,800 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0006_000001 (auth:SIMPLE) 2023-09-13 03:00:59,762 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 03:01:02,332 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0006_000001 (auth:SIMPLE) 2023-09-13 03:01:05,823 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 03:01:05,824 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 03:01:05,829 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:01:05,829 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 03:01:05,829 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 03:01:05,829 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:01:05,830 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-13 03:01:05,830 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-13 03:01:05,830 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:01:05,830 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-13 03:01:05,830 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574056200/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-13 03:01:05,835 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-13 03:01:05,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-09-13 03:01:05,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:05,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 03:01:05,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574065839"}]},"ts":"1694574065839"} 2023-09-13 03:01:05,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-13 03:01:05,843 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-13 03:01:05,844 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, UNASSIGN}] 2023-09-13 03:01:05,848 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, UNASSIGN 2023-09-13 03:01:05,848 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, UNASSIGN 2023-09-13 03:01:05,848 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=154759cba1cf7f58c9414efb50b4d048, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:05,848 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2ac58e8416eec79930bb895dabf137ae, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:05,848 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574065848"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574065848"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574065848"}]},"ts":"1694574065848"} 2023-09-13 03:01:05,849 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574065848"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574065848"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574065848"}]},"ts":"1694574065848"} 2023-09-13 03:01:05,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 154759cba1cf7f58c9414efb50b4d048, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:01:05,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 2ac58e8416eec79930bb895dabf137ae, server=jenkins-hbase9.apache.org,35085,1694573969420}] 2023-09-13 03:01:05,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 03:01:06,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:01:06,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:01:06,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2ac58e8416eec79930bb895dabf137ae, disabling compactions & flushes 2023-09-13 03:01:06,002 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:01:06,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:01:06,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 154759cba1cf7f58c9414efb50b4d048, disabling compactions & flushes 2023-09-13 03:01:06,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. after waiting 0 ms 2023-09-13 03:01:06,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:01:06,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:01:06,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:01:06,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. after waiting 0 ms 2023-09-13 03:01:06,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:01:06,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:01:06,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:06,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae. 2023-09-13 03:01:06,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2ac58e8416eec79930bb895dabf137ae: 2023-09-13 03:01:06,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:01:06,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:06,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048. 2023-09-13 03:01:06,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 154759cba1cf7f58c9414efb50b4d048: 2023-09-13 03:01:06,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:01:06,017 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2ac58e8416eec79930bb895dabf137ae, regionState=CLOSED 2023-09-13 03:01:06,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:01:06,017 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574066017"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574066017"}]},"ts":"1694574066017"} 2023-09-13 03:01:06,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=154759cba1cf7f58c9414efb50b4d048, regionState=CLOSED 2023-09-13 03:01:06,021 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694574066020"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574066020"}]},"ts":"1694574066020"} 2023-09-13 03:01:06,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-13 03:01:06,022 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 2ac58e8416eec79930bb895dabf137ae, server=jenkins-hbase9.apache.org,35085,1694573969420 in 171 msec 2023-09-13 03:01:06,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=2ac58e8416eec79930bb895dabf137ae, UNASSIGN in 178 msec 2023-09-13 03:01:06,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-13 03:01:06,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 154759cba1cf7f58c9414efb50b4d048, server=jenkins-hbase9.apache.org,45847,1694573969506 in 172 msec 2023-09-13 03:01:06,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-13 03:01:06,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=154759cba1cf7f58c9414efb50b4d048, UNASSIGN in 180 msec 2023-09-13 03:01:06,025 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574066025"}]},"ts":"1694574066025"} 2023-09-13 03:01:06,026 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-13 03:01:06,028 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-13 03:01:06,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 194 msec 2023-09-13 03:01:06,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-13 03:01:06,141 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-13 03:01:06,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,144 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,145 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,146 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,148 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,148 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,148 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,148 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,148 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:01:06,148 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:01:06,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 03:01:06,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 03:01:06,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 03:01:06,149 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-13 03:01:06,150 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/recovered.edits] 2023-09-13 03:01:06,150 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/recovered.edits] 2023-09-13 03:01:06,154 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf/f237d3c942c24a92a09039fe84b908cf to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/cf/f237d3c942c24a92a09039fe84b908cf 2023-09-13 03:01:06,154 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf/469de3bd43ca4d25b3de7dc41c91aad8 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/cf/469de3bd43ca4d25b3de7dc41c91aad8 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,156 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-13 03:01:06,158 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae/recovered.edits/9.seqid 2023-09-13 03:01:06,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048/recovered.edits/9.seqid 2023-09-13 03:01:06,158 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/2ac58e8416eec79930bb895dabf137ae 2023-09-13 03:01:06,158 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testEmptyExportFileSystemState/154759cba1cf7f58c9414efb50b4d048 2023-09-13 03:01:06,158 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-13 03:01:06,159 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-13 03:01:06,159 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-13 03:01:06,162 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913688e1d9225554346bddd11f69614ab6e to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230913688e1d9225554346bddd11f69614ab6e 2023-09-13 03:01:06,163 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913ab9ea38b07d743ed900f9635f1018d25 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230913ab9ea38b07d743ed900f9635f1018d25 2023-09-13 03:01:06,164 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-13 03:01:06,166 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,167 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-13 03:01:06,169 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-13 03:01:06,169 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,170 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-13 03:01:06,170 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574066170"}]},"ts":"9223372036854775807"} 2023-09-13 03:01:06,170 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574066170"}]},"ts":"9223372036854775807"} 2023-09-13 03:01:06,171 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 03:01:06,171 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2ac58e8416eec79930bb895dabf137ae, NAME => 'testtb-testEmptyExportFileSystemState,,1694574054895.2ac58e8416eec79930bb895dabf137ae.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 154759cba1cf7f58c9414efb50b4d048, NAME => 'testtb-testEmptyExportFileSystemState,1,1694574054895.154759cba1cf7f58c9414efb50b4d048.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 03:01:06,171 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-13 03:01:06,172 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694574066171"}]},"ts":"9223372036854775807"} 2023-09-13 03:01:06,173 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-13 03:01:06,175 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-13 03:01:06,176 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 34 msec 2023-09-13 03:01:06,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-13 03:01:06,258 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-13 03:01:06,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-13 03:01:06,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-13 03:01:06,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-13 03:01:06,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-13 03:01:06,291 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 759) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2026157744_1 at /127.0.0.1:56900 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:34113 from appattempt_1694573975642_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:51190 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:36613 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4486 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:39866 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-659124466_17 at /127.0.0.1:56918 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2026157744_1 at /127.0.0.1:51164 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1966361669) connection to jenkins-hbase9.apache.org/172.31.2.10:42855 from appattempt_1694573975642_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x69dc80a9-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 912) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 124) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=5706 (was 5776) 2023-09-13 03:01:06,292 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-13 03:01:06,311 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=168, AvailableMemoryMB=5705 2023-09-13 03:01:06,311 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-13 03:01:06,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-13 03:01:06,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,315 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-13 03:01:06,315 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-13 03:01:06,315 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-13 03:01:06,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 03:01:06,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,318 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,318 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 empty. 2023-09-13 03:01:06,318 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 empty. 2023-09-13 03:01:06,319 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,319 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,319 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-13 03:01:06,330 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-13 03:01:06,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2d1b90167fa52dac78223a4d69786fb7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:01:06,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 523bdb457dfb64ba9d057d7245fa4ae4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp 2023-09-13 03:01:06,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:01:06,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 523bdb457dfb64ba9d057d7245fa4ae4, disabling compactions & flushes 2023-09-13 03:01:06,345 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. after waiting 0 ms 2023-09-13 03:01:06,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,345 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,345 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 523bdb457dfb64ba9d057d7245fa4ae4: 2023-09-13 03:01:06,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:01:06,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 2d1b90167fa52dac78223a4d69786fb7, disabling compactions & flushes 2023-09-13 03:01:06,349 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. after waiting 0 ms 2023-09-13 03:01:06,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,349 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,349 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 2d1b90167fa52dac78223a4d69786fb7: 2023-09-13 03:01:06,351 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-13 03:01:06,352 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574066352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574066352"}]},"ts":"1694574066352"} 2023-09-13 03:01:06,353 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574066352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574066352"}]},"ts":"1694574066352"} 2023-09-13 03:01:06,354 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-13 03:01:06,357 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-13 03:01:06,357 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574066357"}]},"ts":"1694574066357"} 2023-09-13 03:01:06,358 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-13 03:01:06,360 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-09-13 03:01:06,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-13 03:01:06,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-13 03:01:06,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-13 03:01:06,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-13 03:01:06,362 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, ASSIGN}] 2023-09-13 03:01:06,364 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, ASSIGN 2023-09-13 03:01:06,364 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, ASSIGN 2023-09-13 03:01:06,364 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44723,1694573969468; forceNewPlan=false, retain=false 2023-09-13 03:01:06,364 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,45847,1694573969506; forceNewPlan=false, retain=false 2023-09-13 03:01:06,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 03:01:06,515 INFO [jenkins-hbase9:34685] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-13 03:01:06,517 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=523bdb457dfb64ba9d057d7245fa4ae4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,517 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2d1b90167fa52dac78223a4d69786fb7, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,518 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574066517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574066517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574066517"}]},"ts":"1694574066517"} 2023-09-13 03:01:06,518 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574066517"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574066517"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574066517"}]},"ts":"1694574066517"} 2023-09-13 03:01:06,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure 2d1b90167fa52dac78223a4d69786fb7, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:01:06,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 523bdb457dfb64ba9d057d7245fa4ae4, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:01:06,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 03:01:06,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d1b90167fa52dac78223a4d69786fb7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.', STARTKEY => '', ENDKEY => '1'} 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. service=AccessControlService 2023-09-13 03:01:06,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 523bdb457dfb64ba9d057d7245fa4ae4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.', STARTKEY => '1', ENDKEY => ''} 2023-09-13 03:01:06,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. service=AccessControlService 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,675 INFO [StoreOpener-523bdb457dfb64ba9d057d7245fa4ae4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,676 INFO [StoreOpener-2d1b90167fa52dac78223a4d69786fb7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,677 DEBUG [StoreOpener-523bdb457dfb64ba9d057d7245fa4ae4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf 2023-09-13 03:01:06,677 DEBUG [StoreOpener-2d1b90167fa52dac78223a4d69786fb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf 2023-09-13 03:01:06,677 DEBUG [StoreOpener-523bdb457dfb64ba9d057d7245fa4ae4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf 2023-09-13 03:01:06,677 DEBUG [StoreOpener-2d1b90167fa52dac78223a4d69786fb7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf 2023-09-13 03:01:06,677 INFO [StoreOpener-523bdb457dfb64ba9d057d7245fa4ae4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 523bdb457dfb64ba9d057d7245fa4ae4 columnFamilyName cf 2023-09-13 03:01:06,677 INFO [StoreOpener-2d1b90167fa52dac78223a4d69786fb7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d1b90167fa52dac78223a4d69786fb7 columnFamilyName cf 2023-09-13 03:01:06,678 INFO [StoreOpener-523bdb457dfb64ba9d057d7245fa4ae4-1] regionserver.HStore(310): Store=523bdb457dfb64ba9d057d7245fa4ae4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:01:06,678 INFO [StoreOpener-2d1b90167fa52dac78223a4d69786fb7-1] regionserver.HStore(310): Store=2d1b90167fa52dac78223a4d69786fb7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-13 03:01:06,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:06,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:06,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:01:06,684 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-13 03:01:06,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 523bdb457dfb64ba9d057d7245fa4ae4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63690823, jitterRate=-0.05093277990818024}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:01:06,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 523bdb457dfb64ba9d057d7245fa4ae4: 2023-09-13 03:01:06,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 2d1b90167fa52dac78223a4d69786fb7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64787392, jitterRate=-0.034592628479003906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-13 03:01:06,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 2d1b90167fa52dac78223a4d69786fb7: 2023-09-13 03:01:06,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4., pid=109, masterSystemTime=1694574066671 2023-09-13 03:01:06,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7., pid=108, masterSystemTime=1694574066670 2023-09-13 03:01:06,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2d1b90167fa52dac78223a4d69786fb7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,688 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574066687"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574066687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574066687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574066687"}]},"ts":"1694574066687"} 2023-09-13 03:01:06,688 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=523bdb457dfb64ba9d057d7245fa4ae4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,688 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574066688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1694574066688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694574066688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694574066688"}]},"ts":"1694574066688"} 2023-09-13 03:01:06,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-13 03:01:06,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure 2d1b90167fa52dac78223a4d69786fb7, server=jenkins-hbase9.apache.org,45847,1694573969506 in 170 msec 2023-09-13 03:01:06,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-13 03:01:06,691 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 523bdb457dfb64ba9d057d7245fa4ae4, server=jenkins-hbase9.apache.org,44723,1694573969468 in 171 msec 2023-09-13 03:01:06,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, ASSIGN in 329 msec 2023-09-13 03:01:06,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-13 03:01:06,693 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, ASSIGN in 329 msec 2023-09-13 03:01:06,693 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-13 03:01:06,693 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574066693"}]},"ts":"1694574066693"} 2023-09-13 03:01:06,694 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-13 03:01:06,698 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-13 03:01:06,698 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-13 03:01:06,700 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 03:01:06,701 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,701 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,701 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,701 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:06,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 03:01:06,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 03:01:06,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 03:01:06,703 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-13 03:01:06,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 391 msec 2023-09-13 03:01:06,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-13 03:01:06,919 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-13 03:01:06,919 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-13 03:01:06,920 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,920 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,922 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:01:06,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 03:01:06,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574066931 (current time:1694574066931). 2023-09-13 03:01:06,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:01:06,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x39ddf2d0 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:01:06,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75531801, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:01:06,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:01:06,941 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:01:06,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39ddf2d0 to 127.0.0.1:53387 2023-09-13 03:01:06,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:06,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x09ef8704 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:01:06,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f72af9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:01:06,949 DEBUG [hconnection-0x320c2764-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:01:06,951 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:01:06,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:01:06,956 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:34622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:01:06,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09ef8704 to 127.0.0.1:53387 2023-09-13 03:01:06,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:06,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 03:01:06,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:01:06,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 03:01:06,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 03:01:06,960 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 03:01:06,961 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694574666961 2023-09-13 03:01:06,961 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 03:01:06,962 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:01:06,962 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:01:06,963 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 03:01:06,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 03:01:06,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-13 03:01:06,964 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 03:01:06,965 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694574666965 2023-09-13 03:01:06,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,976 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-13 03:01:06,976 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:06,977 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-13 03:01:06,977 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-13 03:01:06,978 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,978 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:06,979 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:06,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:06,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:06,979 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,979 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:06,979 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,980 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,980 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:01:06,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 03:01:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 03:01:06,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,981 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 03:01:06,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,982 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 03:01:06,982 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 03:01:06,982 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:06,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,983 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 03:01:06,983 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 03:01:06,982 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:06,983 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 03:01:06,984 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 03:01:06,984 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 03:01:06,984 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 03:01:06,983 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 03:01:06,984 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 03:01:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 03:01:06,985 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 03:01:06,992 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,992 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:06,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:01:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:01:06,993 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,993 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:01:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:06,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:06,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:06,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 03:01:06,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f482f69[Count = 1] remaining members to acquire global barrier 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:06,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:06,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 03:01:06,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f482f69[Count = 0] remaining members to acquire global barrier 2023-09-13 03:01:06,996 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-13 03:01:06,996 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 03:01:06,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 03:01:06,999 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:01:06,999 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:06,999 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:06,999 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:01:06,999 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. started... 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:01:06,999 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:01:06,999 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. started... 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 523bdb457dfb64ba9d057d7245fa4ae4: 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d1b90167fa52dac78223a4d69786fb7: 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:01:07,000 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-13 03:01:07,002 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 03:01:07,002 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,002 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 03:01:07,017 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. completed. 2023-09-13 03:01:07,017 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:07,017 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:01:07,017 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:01:07,017 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,017 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 03:01:07,017 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:01:07,019 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. completed. 2023-09-13 03:01:07,019 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 03:01:07,019 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:07,019 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,019 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:01:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,019 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,019 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 03:01:07,019 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:01:07,020 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,020 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 03:01:07,020 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:01:07,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,022 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,022 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 03:01:07,022 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,022 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 03:01:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:01:07,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-13 03:01:07,028 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-13 03:01:07,028 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:01:07,028 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:01:07,028 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,028 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,031 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,031 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,031 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,033 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,033 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,033 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,037 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:01:07,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,037 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,039 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,063 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:01:07,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 03:01:07,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:01:07,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-13 03:01:07,064 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:01:07,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,064 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,064 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694574066961Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694574067045 (+84 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694574067045Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694574067045Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694574067049 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694574067059 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694574067064 (+5 ms) 2023-09-13 03:01:07,066 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 03:01:07,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 104 msec 2023-09-13 03:01:07,264 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:01:07,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 03:01:07,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:01:07,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45847] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:01:07,267 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44723] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. with WAL disabled. Data may be lost in the event of a crash. 2023-09-13 03:01:07,270 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,270 DEBUG [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:07,270 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-13 03:01:07,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 03:01:07,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694574067279 (current time:1694574067279). 2023-09-13 03:01:07,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-13 03:01:07,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x761f14bc to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:01:07,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@25fb2a1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:01:07,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:01:07,287 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:01:07,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x761f14bc to 127.0.0.1:53387 2023-09-13 03:01:07,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:07,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(139): Connect 0x43f34d35 to 127.0.0.1:53387 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-13 03:01:07,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dc70b03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-13 03:01:07,294 DEBUG [hconnection-0x3110736d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:01:07,300 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:53110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:01:07,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-13 03:01:07,306 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-13 03:01:07,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43f34d35 to 127.0.0.1:53387 2023-09-13 03:01:07,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:07,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-13 03:01:07,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-13 03:01:07,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 03:01:07,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 03:01:07,310 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 03:01:07,310 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694574667310 2023-09-13 03:01:07,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-13 03:01:07,311 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-13 03:01:07,311 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-13 03:01:07,312 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-13 03:01:07,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 03:01:07,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-13 03:01:07,314 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 03:01:07,314 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694574667314 2023-09-13 03:01:07,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,327 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-13 03:01:07,327 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:07,328 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-13 03:01:07,328 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-13 03:01:07,329 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,329 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,330 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,330 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,330 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,330 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,331 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-13 03:01:07,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,332 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-13 03:01:07,332 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 03:01:07,332 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:07,332 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:07,332 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,337 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-13 03:01:07,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 03:01:07,339 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-13 03:01:07,339 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35085,1694573969420' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 03:01:07,338 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-13 03:01:07,340 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,340 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,341 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:01:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,341 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-13 03:01:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,45847,1694573969506' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e2bfa85[Count = 1] remaining members to acquire global barrier 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44723,1694573969468' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-13 03:01:07,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e2bfa85[Count = 0] remaining members to acquire global barrier 2023-09-13 03:01:07,345 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-13 03:01:07,345 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 03:01:07,351 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:01:07,351 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,351 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-13 03:01:07,351 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. started... 2023-09-13 03:01:07,351 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. started... 2023-09-13 03:01:07,351 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,351 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-13 03:01:07,351 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d1b90167fa52dac78223a4d69786fb7 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-13 03:01:07,351 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 523bdb457dfb64ba9d057d7245fa4ae4 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 03:01:07,351 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35085,1694573969420' in zk 2023-09-13 03:01:07,353 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 03:01:07,353 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,353 DEBUG [member: 'jenkins-hbase9.apache.org,35085,1694573969420' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 03:01:07,375 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309131cf6c93aa4df428296bbb05c6a779d23 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309131cf6c93aa4df428296bbb05c6a779d23 2023-09-13 03:01:07,375 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309137e98c3efbf8f4341861cca058a154df5 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309137e98c3efbf8f4341861cca058a154df5 2023-09-13 03:01:07,392 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/.tmp/cf/3a6bfc240cea4ac8b2ab235656830318 2023-09-13 03:01:07,397 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/.tmp/cf/3a6bfc240cea4ac8b2ab235656830318 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf/3a6bfc240cea4ac8b2ab235656830318 2023-09-13 03:01:07,400 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/.tmp/cf/275e276a6f00420092949f543a63e536 2023-09-13 03:01:07,402 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf/3a6bfc240cea4ac8b2ab235656830318, entries=47, sequenceid=6, filesize=13.4 K 2023-09-13 03:01:07,403 INFO [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 523bdb457dfb64ba9d057d7245fa4ae4 in 52ms, sequenceid=6, compaction requested=false 2023-09-13 03:01:07,404 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 523bdb457dfb64ba9d057d7245fa4ae4: 2023-09-13 03:01:07,404 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,404 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:01:07,404 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf/3a6bfc240cea4ac8b2ab235656830318] hfiles 2023-09-13 03:01:07,405 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf/3a6bfc240cea4ac8b2ab235656830318 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,406 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/.tmp/cf/275e276a6f00420092949f543a63e536 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf/275e276a6f00420092949f543a63e536 2023-09-13 03:01:07,410 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf/275e276a6f00420092949f543a63e536, entries=3, sequenceid=6, filesize=5.4 K 2023-09-13 03:01:07,411 INFO [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2d1b90167fa52dac78223a4d69786fb7 in 60ms, sequenceid=6, compaction requested=false 2023-09-13 03:01:07,411 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d1b90167fa52dac78223a4d69786fb7: 2023-09-13 03:01:07,411 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,411 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-13 03:01:07,411 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf/275e276a6f00420092949f543a63e536] hfiles 2023-09-13 03:01:07,411 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf/275e276a6f00420092949f543a63e536 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,412 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:01:07,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 03:01:07,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-13 03:01:07,413 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-13 03:01:07,414 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. completed. 2023-09-13 03:01:07,414 DEBUG [rs(jenkins-hbase9.apache.org,44723,1694573969468)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:01:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:01:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 03:01:07,415 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44723,1694573969468' in zk 2023-09-13 03:01:07,416 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 03:01:07,416 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,417 DEBUG [member: 'jenkins-hbase9.apache.org,44723,1694573969468' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 03:01:07,418 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,419 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. completed. 2023-09-13 03:01:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,419 DEBUG [rs(jenkins-hbase9.apache.org,45847,1694573969506)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:07,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-13 03:01:07,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-13 03:01:07,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-13 03:01:07,419 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,45847,1694573969506' in zk 2023-09-13 03:01:07,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,422 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,422 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-13 03:01:07,422 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,422 DEBUG [member: 'jenkins-hbase9.apache.org,45847,1694573969506' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-13 03:01:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44723,1694573969468': 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44723,1694573969468' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,45847,1694573969506': 2023-09-13 03:01:07,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,45847,1694573969506' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-13 03:01:07,428 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-13 03:01:07,428 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-13 03:01:07,428 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-13 03:01:07,428 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,428 INFO [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-13 03:01:07,429 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-13 03:01:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-13 03:01:07,429 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,429 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,429 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,430 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-13 03:01:07,430 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-13 03:01:07,432 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,432 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,433 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,435 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,435 DEBUG [(jenkins-hbase9.apache.org,34685,1694573968233)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,436 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,435 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-13 03:01:07,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-13 03:01:07,436 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-13 03:01:07,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-13 03:01:07,437 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,437 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:07,437 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:07,437 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-13 03:01:07,437 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-13 03:01:07,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309131cf6c93aa4df428296bbb05c6a779d23, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309137e98c3efbf8f4341861cca058a154df5] mob files 2023-09-13 03:01:07,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309131cf6c93aa4df428296bbb05c6a779d23 2023-09-13 03:01:07,438 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309137e98c3efbf8f4341861cca058a154df5 2023-09-13 03:01:07,443 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,462 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-13 03:01:07,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,462 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694574067310Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694574067443 (+133 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694574067443Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694574067443Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694574067446 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694574067452 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694574067462 (+10 ms) 2023-09-13 03:01:07,464 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-13 03:01:07,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 154 msec 2023-09-13 03:01:07,614 DEBUG [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-13 03:01:07,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-13 03:01:07,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-13 03:01:07,615 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615 2023-09-13 03:01:07,615 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:34433, tgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615, rawTgtDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615, srcFsUri=hdfs://localhost:34433, srcDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:01:07,636 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064 2023-09-13 03:01:07,636 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1794901523_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,636 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:34433, inputRoot=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064, snapshotDir=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-13 03:01:07,647 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:07,667 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:07,667 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:07,667 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:07,668 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,507 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-7593081560945710722.jar 2023-09-13 03:01:08,507 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,508 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,571 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/hadoop-5236028472791385848.jar 2023-09-13 03:01:08,572 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,572 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,572 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,573 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,573 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,573 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-13 03:01:08,574 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-13 03:01:08,574 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-13 03:01:08,574 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-13 03:01:08,575 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-13 03:01:08,575 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-13 03:01:08,575 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-13 03:01:08,576 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-13 03:01:08,576 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-13 03:01:08,576 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-13 03:01:08,577 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-13 03:01:08,577 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:01:08,577 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:01:08,578 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:01:08,578 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:01:08,578 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-13 03:01:08,579 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:01:08,579 DEBUG [Listener at jenkins-hbase9.apache.org/41229] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-13 03:01:08,894 WARN [Listener at jenkins-hbase9.apache.org/41229] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-13 03:01:08,896 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-13 03:01:08,898 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-13 03:01:10,044 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:01:10,044 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-13 03:01:10,048 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0006_000001 (auth:SIMPLE) 2023-09-13 03:01:10,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0007_000001 (auth:SIMPLE) 2023-09-13 03:01:11,603 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 03:01:14,319 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0007_000001 (auth:SIMPLE) 2023-09-13 03:01:16,523 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0007_000001 (auth:SIMPLE) 2023-09-13 03:01:18,985 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694573975642_0007_000001 (auth:SIMPLE) 2023-09-13 03:01:20,039 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-13 03:01:20,039 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-13 03:01:20,054 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,055 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-13 03:01:20,055 INFO [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-13 03:01:20,055 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,056 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-13 03:01:20,056 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-13 03:01:20,056 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-659124466_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,056 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-13 03:01:20,056 DEBUG [Listener at jenkins-hbase9.apache.org/41229] snapshot.TestExportSnapshot(367): hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/export-test/export-1694574067615/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-13 03:01:20,062 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 03:01:20,066 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574080066"}]},"ts":"1694574080066"} 2023-09-13 03:01:20,068 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-13 03:01:20,069 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-13 03:01:20,070 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, UNASSIGN}] 2023-09-13 03:01:20,072 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, UNASSIGN 2023-09-13 03:01:20,072 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, UNASSIGN 2023-09-13 03:01:20,073 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2d1b90167fa52dac78223a4d69786fb7, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:20,073 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=523bdb457dfb64ba9d057d7245fa4ae4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:20,073 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574080073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574080073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574080073"}]},"ts":"1694574080073"} 2023-09-13 03:01:20,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574080073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1694574080073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694574080073"}]},"ts":"1694574080073"} 2023-09-13 03:01:20,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 2d1b90167fa52dac78223a4d69786fb7, server=jenkins-hbase9.apache.org,45847,1694573969506}] 2023-09-13 03:01:20,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 523bdb457dfb64ba9d057d7245fa4ae4, server=jenkins-hbase9.apache.org,44723,1694573969468}] 2023-09-13 03:01:20,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 03:01:20,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:20,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 2d1b90167fa52dac78223a4d69786fb7, disabling compactions & flushes 2023-09-13 03:01:20,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:20,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:20,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. after waiting 0 ms 2023-09-13 03:01:20,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:20,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:20,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 523bdb457dfb64ba9d057d7245fa4ae4, disabling compactions & flushes 2023-09-13 03:01:20,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:20,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:20,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. after waiting 0 ms 2023-09-13 03:01:20,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:20,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:01:20,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:01:20,238 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:20,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7. 2023-09-13 03:01:20,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 2d1b90167fa52dac78223a4d69786fb7: 2023-09-13 03:01:20,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:20,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4. 2023-09-13 03:01:20,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 523bdb457dfb64ba9d057d7245fa4ae4: 2023-09-13 03:01:20,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:20,242 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2d1b90167fa52dac78223a4d69786fb7, regionState=CLOSED 2023-09-13 03:01:20,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:20,242 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574080242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574080242"}]},"ts":"1694574080242"} 2023-09-13 03:01:20,242 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=523bdb457dfb64ba9d057d7245fa4ae4, regionState=CLOSED 2023-09-13 03:01:20,242 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694574080242"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694574080242"}]},"ts":"1694574080242"} 2023-09-13 03:01:20,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-13 03:01:20,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 2d1b90167fa52dac78223a4d69786fb7, server=jenkins-hbase9.apache.org,45847,1694573969506 in 169 msec 2023-09-13 03:01:20,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-13 03:01:20,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 523bdb457dfb64ba9d057d7245fa4ae4, server=jenkins-hbase9.apache.org,44723,1694573969468 in 169 msec 2023-09-13 03:01:20,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2d1b90167fa52dac78223a4d69786fb7, UNASSIGN in 175 msec 2023-09-13 03:01:20,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-13 03:01:20,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=523bdb457dfb64ba9d057d7245fa4ae4, UNASSIGN in 177 msec 2023-09-13 03:01:20,248 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694574080248"}]},"ts":"1694574080248"} 2023-09-13 03:01:20,249 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-13 03:01:20,251 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-13 03:01:20,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 188 msec 2023-09-13 03:01:20,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-13 03:01:20,368 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-13 03:01:20,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,372 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,374 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35085] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,376 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:20,376 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:20,377 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,377 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,377 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,377 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 03:01:20,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 03:01:20,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 03:01:20,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-13 03:01:20,379 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/recovered.edits] 2023-09-13 03:01:20,379 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf, FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/recovered.edits] 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:20,379 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-13 03:01:20,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-13 03:01:20,383 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf/275e276a6f00420092949f543a63e536 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/cf/275e276a6f00420092949f543a63e536 2023-09-13 03:01:20,383 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf/3a6bfc240cea4ac8b2ab235656830318 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/cf/3a6bfc240cea4ac8b2ab235656830318 2023-09-13 03:01:20,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7/recovered.edits/9.seqid 2023-09-13 03:01:20,387 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/recovered.edits/9.seqid to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4/recovered.edits/9.seqid 2023-09-13 03:01:20,387 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2d1b90167fa52dac78223a4d69786fb7 2023-09-13 03:01:20,387 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/523bdb457dfb64ba9d057d7245fa4ae4 2023-09-13 03:01:20,387 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-13 03:01:20,388 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-13 03:01:20,388 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-13 03:01:20,391 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309131cf6c93aa4df428296bbb05c6a779d23 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202309131cf6c93aa4df428296bbb05c6a779d23 2023-09-13 03:01:20,392 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309137e98c3efbf8f4341861cca058a154df5 to hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309137e98c3efbf8f4341861cca058a154df5 2023-09-13 03:01:20,393 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-13 03:01:20,394 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,396 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-13 03:01:20,398 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-13 03:01:20,399 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,399 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-13 03:01:20,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574080399"}]},"ts":"9223372036854775807"} 2023-09-13 03:01:20,399 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694574080399"}]},"ts":"9223372036854775807"} 2023-09-13 03:01:20,401 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-13 03:01:20,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2d1b90167fa52dac78223a4d69786fb7, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694574066312.2d1b90167fa52dac78223a4d69786fb7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 523bdb457dfb64ba9d057d7245fa4ae4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694574066312.523bdb457dfb64ba9d057d7245fa4ae4.', STARTKEY => '1', ENDKEY => ''}] 2023-09-13 03:01:20,401 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-13 03:01:20,401 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694574080401"}]},"ts":"9223372036854775807"} 2023-09-13 03:01:20,402 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-13 03:01:20,404 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,405 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 35 msec 2023-09-13 03:01:20,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-13 03:01:20,481 INFO [Listener at jenkins-hbase9.apache.org/41229] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-13 03:01:20,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-13 03:01:20,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-13 03:01:20,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34685] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-13 03:01:20,514 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 764), OpenFileDescriptor=912 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=133 (was 172), ProcessCount=168 (was 168), AvailableMemoryMB=5636 (was 5705) 2023-09-13 03:01:20,515 WARN [Listener at jenkins-hbase9.apache.org/41229] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-13 03:01:20,515 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-13 03:01:20,524 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-13 03:01:20,635 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694573975642_0007_01_000001 is : 143 2023-09-13 03:01:25,806 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-13 03:01:34,652 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-13 03:01:48,771 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 03:01:48,772 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-13 03:01:48,885 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-13 03:01:48,892 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-13 03:01:48,893 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 03:01:48,901 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-09-13 03:01:49,005 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-13 03:01:49,005 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-13 03:01:49,005 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-13 03:01:49,005 INFO [Listener at jenkins-hbase9.apache.org/41229] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-13 03:01:49,005 DEBUG [Listener at jenkins-hbase9.apache.org/41229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x627146cd to 127.0.0.1:53387 2023-09-13 03:01:49,005 DEBUG [Listener at jenkins-hbase9.apache.org/41229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,006 DEBUG [Listener at jenkins-hbase9.apache.org/41229] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-13 03:01:49,006 DEBUG [Listener at jenkins-hbase9.apache.org/41229] util.JVMClusterUtil(257): Found active master hash=269145428, stopped=false 2023-09-13 03:01:49,006 DEBUG [Listener at jenkins-hbase9.apache.org/41229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,006 DEBUG [Listener at jenkins-hbase9.apache.org/41229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-13 03:01:49,006 INFO [Listener at jenkins-hbase9.apache.org/41229] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 03:01:49,007 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 03:01:49,007 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 03:01:49,007 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 03:01:49,007 INFO [Listener at jenkins-hbase9.apache.org/41229] procedure2.ProcedureExecutor(628): Stopping 2023-09-13 03:01:49,007 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 03:01:49,007 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-13 03:01:49,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 03:01:49,008 DEBUG [Listener at jenkins-hbase9.apache.org/41229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x663bc032 to 127.0.0.1:53387 2023-09-13 03:01:49,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 03:01:49,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 03:01:49,008 DEBUG [Listener at jenkins-hbase9.apache.org/41229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,008 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-13 03:01:49,008 INFO [Listener at jenkins-hbase9.apache.org/41229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35085,1694573969420' ***** 2023-09-13 03:01:49,009 DEBUG [Listener at jenkins-hbase9.apache.org/41229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,009 INFO [Listener at jenkins-hbase9.apache.org/41229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 03:01:49,009 INFO [Listener at jenkins-hbase9.apache.org/41229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44723,1694573969468' ***** 2023-09-13 03:01:49,009 DEBUG [Listener at jenkins-hbase9.apache.org/41229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,009 INFO [RS:0;jenkins-hbase9:35085] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 03:01:49,009 INFO [Listener at jenkins-hbase9.apache.org/41229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 03:01:49,009 INFO [Listener at jenkins-hbase9.apache.org/41229] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,45847,1694573969506' ***** 2023-09-13 03:01:49,009 INFO [RS:1;jenkins-hbase9:44723] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 03:01:49,009 INFO [RS:0;jenkins-hbase9:35085] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 03:01:49,009 DEBUG [Listener at jenkins-hbase9.apache.org/41229] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,009 INFO [RS:0;jenkins-hbase9:35085] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 03:01:49,009 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 03:01:49,009 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 03:01:49,009 INFO [RS:1;jenkins-hbase9:44723] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 03:01:49,009 INFO [Listener at jenkins-hbase9.apache.org/41229] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-13 03:01:49,009 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(3305): Received CLOSE for f28d2870f42268ba9884db2abddbf11d 2023-09-13 03:01:49,010 INFO [RS:2;jenkins-hbase9:45847] regionserver.HeapMemoryManager(220): Stopping 2023-09-13 03:01:49,009 INFO [RS:1;jenkins-hbase9:44723] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 03:01:49,010 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-13 03:01:49,010 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:49,010 INFO [RS:2;jenkins-hbase9:45847] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-13 03:01:49,010 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:49,010 INFO [RS:2;jenkins-hbase9:45847] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-13 03:01:49,010 DEBUG [RS:1;jenkins-hbase9:44723] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b31b604 to 127.0.0.1:53387 2023-09-13 03:01:49,010 DEBUG [RS:0;jenkins-hbase9:35085] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b95e206 to 127.0.0.1:53387 2023-09-13 03:01:49,010 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(3305): Received CLOSE for 52690797349158d4b188dff423435b38 2023-09-13 03:01:49,010 DEBUG [RS:1;jenkins-hbase9:44723] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,011 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:49,011 DEBUG [RS:0;jenkins-hbase9:35085] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f28d2870f42268ba9884db2abddbf11d, disabling compactions & flushes 2023-09-13 03:01:49,013 INFO [RS:1;jenkins-hbase9:44723] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 03:01:49,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 52690797349158d4b188dff423435b38, disabling compactions & flushes 2023-09-13 03:01:49,012 DEBUG [RS:2;jenkins-hbase9:45847] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x38d23ecb to 127.0.0.1:53387 2023-09-13 03:01:49,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 03:01:49,013 DEBUG [RS:2;jenkins-hbase9:45847] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,013 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 03:01:49,014 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 03:01:49,013 INFO [RS:1;jenkins-hbase9:44723] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 03:01:49,013 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 03:01:49,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 03:01:49,014 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1478): Online Regions={f28d2870f42268ba9884db2abddbf11d=hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d.} 2023-09-13 03:01:49,014 INFO [RS:1;jenkins-hbase9:44723] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 03:01:49,014 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1478): Online Regions={52690797349158d4b188dff423435b38=hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38.} 2023-09-13 03:01:49,014 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-13 03:01:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. after waiting 0 ms 2023-09-13 03:01:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 03:01:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. after waiting 0 ms 2023-09-13 03:01:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 03:01:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 03:01:49,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 52690797349158d4b188dff423435b38 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-13 03:01:49,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing f28d2870f42268ba9884db2abddbf11d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-13 03:01:49,015 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-13 03:01:49,015 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-13 03:01:49,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-13 03:01:49,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-13 03:01:49,015 DEBUG [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-13 03:01:49,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-13 03:01:49,015 DEBUG [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1504): Waiting on 52690797349158d4b188dff423435b38 2023-09-13 03:01:49,015 DEBUG [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1504): Waiting on f28d2870f42268ba9884db2abddbf11d 2023-09-13 03:01:49,015 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-13 03:01:49,016 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-13 03:01:49,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-13 03:01:49,030 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 03:01:49,030 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 03:01:49,030 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-13 03:01:49,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/.tmp/l/2a05213450ee46e0a5d1bea5cda3e9c7 2023-09-13 03:01:49,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/.tmp/info/6022f8d153c64c91816707da6d6ef8e5 2023-09-13 03:01:49,034 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/.tmp/info/97320c9747a14448998ebdc3a4dfbb4f 2023-09-13 03:01:49,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a05213450ee46e0a5d1bea5cda3e9c7 2023-09-13 03:01:49,038 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/.tmp/l/2a05213450ee46e0a5d1bea5cda3e9c7 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/l/2a05213450ee46e0a5d1bea5cda3e9c7 2023-09-13 03:01:49,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97320c9747a14448998ebdc3a4dfbb4f 2023-09-13 03:01:49,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/.tmp/info/6022f8d153c64c91816707da6d6ef8e5 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/info/6022f8d153c64c91816707da6d6ef8e5 2023-09-13 03:01:49,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a05213450ee46e0a5d1bea5cda3e9c7 2023-09-13 03:01:49,046 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/l/2a05213450ee46e0a5d1bea5cda3e9c7, entries=7, sequenceid=18, filesize=5.2 K 2023-09-13 03:01:49,047 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for f28d2870f42268ba9884db2abddbf11d in 33ms, sequenceid=18, compaction requested=false 2023-09-13 03:01:49,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/info/6022f8d153c64c91816707da6d6ef8e5, entries=2, sequenceid=6, filesize=4.8 K 2023-09-13 03:01:49,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 52690797349158d4b188dff423435b38 in 43ms, sequenceid=6, compaction requested=false 2023-09-13 03:01:49,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/acl/f28d2870f42268ba9884db2abddbf11d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-13 03:01:49,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 03:01:49,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f28d2870f42268ba9884db2abddbf11d: 2023-09-13 03:01:49,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694573972218.f28d2870f42268ba9884db2abddbf11d. 2023-09-13 03:01:49,073 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/.tmp/rep_barrier/6bd2d46f5b1748ac95fa1877d3d69d1f 2023-09-13 03:01:49,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/namespace/52690797349158d4b188dff423435b38/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-13 03:01:49,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 03:01:49,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 52690797349158d4b188dff423435b38: 2023-09-13 03:01:49,075 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694573971488.52690797349158d4b188dff423435b38. 2023-09-13 03:01:49,078 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bd2d46f5b1748ac95fa1877d3d69d1f 2023-09-13 03:01:49,088 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/.tmp/table/a2eb84b0ad1b4ad1a77b97fe1bfac906 2023-09-13 03:01:49,091 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2eb84b0ad1b4ad1a77b97fe1bfac906 2023-09-13 03:01:49,092 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/.tmp/info/97320c9747a14448998ebdc3a4dfbb4f as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/info/97320c9747a14448998ebdc3a4dfbb4f 2023-09-13 03:01:49,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97320c9747a14448998ebdc3a4dfbb4f 2023-09-13 03:01:49,096 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/info/97320c9747a14448998ebdc3a4dfbb4f, entries=48, sequenceid=131, filesize=10.3 K 2023-09-13 03:01:49,096 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/.tmp/rep_barrier/6bd2d46f5b1748ac95fa1877d3d69d1f as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/rep_barrier/6bd2d46f5b1748ac95fa1877d3d69d1f 2023-09-13 03:01:49,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6bd2d46f5b1748ac95fa1877d3d69d1f 2023-09-13 03:01:49,100 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/rep_barrier/6bd2d46f5b1748ac95fa1877d3d69d1f, entries=13, sequenceid=131, filesize=6.4 K 2023-09-13 03:01:49,101 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/.tmp/table/a2eb84b0ad1b4ad1a77b97fe1bfac906 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/table/a2eb84b0ad1b4ad1a77b97fe1bfac906 2023-09-13 03:01:49,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a2eb84b0ad1b4ad1a77b97fe1bfac906 2023-09-13 03:01:49,104 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/table/a2eb84b0ad1b4ad1a77b97fe1bfac906, entries=24, sequenceid=131, filesize=6.9 K 2023-09-13 03:01:49,105 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 89ms, sequenceid=131, compaction requested=false 2023-09-13 03:01:49,114 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-13 03:01:49,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-13 03:01:49,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-13 03:01:49,115 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-13 03:01:49,115 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-13 03:01:49,116 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-13 03:01:49,215 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44723,1694573969468; all regions closed. 2023-09-13 03:01:49,216 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,45847,1694573969506; all regions closed. 2023-09-13 03:01:49,216 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35085,1694573969420; all regions closed. 2023-09-13 03:01:49,228 DEBUG [RS:2;jenkins-hbase9:45847] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs 2023-09-13 03:01:49,229 DEBUG [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs 2023-09-13 03:01:49,229 INFO [RS:2;jenkins-hbase9:45847] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C45847%2C1694573969506:(num 1694573971053) 2023-09-13 03:01:49,229 INFO [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44723%2C1694573969468.meta:.meta(num 1694573971176) 2023-09-13 03:01:49,229 DEBUG [RS:2;jenkins-hbase9:45847] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,229 INFO [RS:2;jenkins-hbase9:45847] regionserver.LeaseManager(133): Closed leases 2023-09-13 03:01:49,229 INFO [RS:2;jenkins-hbase9:45847] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-13 03:01:49,229 INFO [RS:2;jenkins-hbase9:45847] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 03:01:49,229 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 03:01:49,229 INFO [RS:2;jenkins-hbase9:45847] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 03:01:49,230 INFO [RS:2;jenkins-hbase9:45847] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 03:01:49,231 INFO [RS:2;jenkins-hbase9:45847] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:45847 2023-09-13 03:01:49,235 DEBUG [RS:0;jenkins-hbase9:35085] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs 2023-09-13 03:01:49,235 INFO [RS:0;jenkins-hbase9:35085] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35085%2C1694573969420:(num 1694573971053) 2023-09-13 03:01:49,235 DEBUG [RS:0;jenkins-hbase9:35085] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,235 INFO [RS:0;jenkins-hbase9:35085] regionserver.LeaseManager(133): Closed leases 2023-09-13 03:01:49,235 INFO [RS:0;jenkins-hbase9:35085] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-13 03:01:49,236 INFO [RS:0;jenkins-hbase9:35085] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-13 03:01:49,236 INFO [RS:0;jenkins-hbase9:35085] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-13 03:01:49,236 INFO [RS:0;jenkins-hbase9:35085] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-13 03:01:49,236 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 03:01:49,237 INFO [RS:0;jenkins-hbase9:35085] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35085 2023-09-13 03:01:49,237 DEBUG [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/oldWALs 2023-09-13 03:01:49,237 INFO [RS:1;jenkins-hbase9:44723] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44723%2C1694573969468:(num 1694573971053) 2023-09-13 03:01:49,237 DEBUG [RS:1;jenkins-hbase9:44723] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,237 INFO [RS:1;jenkins-hbase9:44723] regionserver.LeaseManager(133): Closed leases 2023-09-13 03:01:49,237 INFO [RS:1;jenkins-hbase9:44723] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-13 03:01:49,238 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 03:01:49,238 INFO [RS:1;jenkins-hbase9:44723] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44723 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35085,1694573969420 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44723,1694573969468 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:49,242 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,45847,1694573969506 2023-09-13 03:01:49,242 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44723,1694573969468] 2023-09-13 03:01:49,243 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44723,1694573969468; numProcessing=1 2023-09-13 03:01:49,245 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44723,1694573969468 already deleted, retry=false 2023-09-13 03:01:49,245 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44723,1694573969468 expired; onlineServers=2 2023-09-13 03:01:49,245 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,45847,1694573969506] 2023-09-13 03:01:49,245 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,45847,1694573969506; numProcessing=2 2023-09-13 03:01:49,246 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,45847,1694573969506 already deleted, retry=false 2023-09-13 03:01:49,246 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,45847,1694573969506 expired; onlineServers=1 2023-09-13 03:01:49,246 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35085,1694573969420] 2023-09-13 03:01:49,246 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35085,1694573969420; numProcessing=3 2023-09-13 03:01:49,247 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35085,1694573969420 already deleted, retry=false 2023-09-13 03:01:49,247 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35085,1694573969420 expired; onlineServers=0 2023-09-13 03:01:49,247 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,34685,1694573968233' ***** 2023-09-13 03:01:49,247 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-13 03:01:49,247 DEBUG [M:0;jenkins-hbase9:34685] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5137df6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-09-13 03:01:49,247 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,34685,1694573968233 2023-09-13 03:01:49,248 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,34685,1694573968233; all regions closed. 2023-09-13 03:01:49,248 DEBUG [M:0;jenkins-hbase9:34685] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-13 03:01:49,248 DEBUG [M:0;jenkins-hbase9:34685] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-13 03:01:49,248 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-13 03:01:49,248 DEBUG [M:0;jenkins-hbase9:34685] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-13 03:01:49,248 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1694573970679] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1694573970679,5,FailOnTimeoutGroup] 2023-09-13 03:01:49,248 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1694573970679] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1694573970679,5,FailOnTimeoutGroup] 2023-09-13 03:01:49,248 INFO [M:0;jenkins-hbase9:34685] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-13 03:01:49,248 INFO [M:0;jenkins-hbase9:34685] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-13 03:01:49,248 INFO [M:0;jenkins-hbase9:34685] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-09-13 03:01:49,249 DEBUG [M:0;jenkins-hbase9:34685] master.HMaster(1512): Stopping service threads 2023-09-13 03:01:49,249 INFO [M:0;jenkins-hbase9:34685] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-13 03:01:49,249 ERROR [M:0;jenkins-hbase9:34685] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-13 03:01:49,250 INFO [M:0;jenkins-hbase9:34685] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-13 03:01:49,250 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-13 03:01:49,250 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-13 03:01:49,250 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-13 03:01:49,250 DEBUG [M:0;jenkins-hbase9:34685] zookeeper.ZKUtil(398): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-13 03:01:49,250 WARN [M:0;jenkins-hbase9:34685] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-13 03:01:49,250 INFO [M:0;jenkins-hbase9:34685] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-13 03:01:49,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-13 03:01:49,251 INFO [M:0;jenkins-hbase9:34685] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-13 03:01:49,251 DEBUG [M:0;jenkins-hbase9:34685] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-13 03:01:49,251 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 03:01:49,251 DEBUG [M:0;jenkins-hbase9:34685] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 03:01:49,251 DEBUG [M:0;jenkins-hbase9:34685] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-13 03:01:49,251 DEBUG [M:0;jenkins-hbase9:34685] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 03:01:49,251 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.67 KB heapSize=452 KB 2023-09-13 03:01:49,266 INFO [M:0;jenkins-hbase9:34685] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.67 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/51efe22fe06749f7bba926a59048e7a0 2023-09-13 03:01:49,270 INFO [M:0;jenkins-hbase9:34685] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51efe22fe06749f7bba926a59048e7a0 2023-09-13 03:01:49,271 DEBUG [M:0;jenkins-hbase9:34685] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/51efe22fe06749f7bba926a59048e7a0 as hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/51efe22fe06749f7bba926a59048e7a0 2023-09-13 03:01:49,275 INFO [M:0;jenkins-hbase9:34685] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51efe22fe06749f7bba926a59048e7a0 2023-09-13 03:01:49,275 INFO [M:0;jenkins-hbase9:34685] regionserver.HStore(1080): Added hdfs://localhost:34433/user/jenkins/test-data/8cc911dc-e5a5-216c-22b6-50a7ec28d064/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/51efe22fe06749f7bba926a59048e7a0, entries=119, sequenceid=899, filesize=28.6 K 2023-09-13 03:01:49,276 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegion(2948): Finished flush of dataSize ~375.67 KB/384691, heapSize ~451.98 KB/462832, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-09-13 03:01:49,278 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-13 03:01:49,278 DEBUG [M:0;jenkins-hbase9:34685] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-13 03:01:49,282 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-13 03:01:49,282 INFO [M:0;jenkins-hbase9:34685] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-13 03:01:49,283 INFO [M:0;jenkins-hbase9:34685] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:34685 2023-09-13 03:01:49,284 DEBUG [M:0;jenkins-hbase9:34685] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,34685,1694573968233 already deleted, retry=false 2023-09-13 03:01:49,345 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,345 INFO [RS:0;jenkins-hbase9:35085] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35085,1694573969420; zookeeper connection closed. 2023-09-13 03:01:49,345 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:35085-0x100a32c2c440001, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,345 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5b79c0b9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5b79c0b9 2023-09-13 03:01:49,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,445 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): master:34685-0x100a32c2c440000, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,445 INFO [M:0;jenkins-hbase9:34685] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,34685,1694573968233; zookeeper connection closed. 2023-09-13 03:01:49,545 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,545 INFO [RS:2;jenkins-hbase9:45847] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,45847,1694573969506; zookeeper connection closed. 2023-09-13 03:01:49,545 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:45847-0x100a32c2c440003, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,546 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6b6519bf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6b6519bf 2023-09-13 03:01:49,645 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,645 INFO [RS:1;jenkins-hbase9:44723] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44723,1694573969468; zookeeper connection closed. 2023-09-13 03:01:49,645 DEBUG [Listener at localhost/44793-EventThread] zookeeper.ZKWatcher(600): regionserver:44723-0x100a32c2c440002, quorum=127.0.0.1:53387, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-13 03:01:49,646 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5b14b28e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5b14b28e 2023-09-13 03:01:49,646 INFO [Listener at jenkins-hbase9.apache.org/41229] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-13 03:01:49,646 WARN [Listener at jenkins-hbase9.apache.org/41229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 03:01:49,649 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 03:01:49,753 WARN [BP-2056046563-172.31.2.10-1694573964554 heartbeating to localhost/127.0.0.1:34433] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 03:01:49,753 WARN [BP-2056046563-172.31.2.10-1694573964554 heartbeating to localhost/127.0.0.1:34433] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2056046563-172.31.2.10-1694573964554 (Datanode Uuid 5dd11235-bdba-4cc7-bc29-5950eb1a59f9) service to localhost/127.0.0.1:34433 2023-09-13 03:01:49,755 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data5/current/BP-2056046563-172.31.2.10-1694573964554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 03:01:49,755 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data6/current/BP-2056046563-172.31.2.10-1694573964554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 03:01:49,756 WARN [Listener at jenkins-hbase9.apache.org/41229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 03:01:49,758 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 03:01:49,860 WARN [BP-2056046563-172.31.2.10-1694573964554 heartbeating to localhost/127.0.0.1:34433] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 03:01:49,860 WARN [BP-2056046563-172.31.2.10-1694573964554 heartbeating to localhost/127.0.0.1:34433] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2056046563-172.31.2.10-1694573964554 (Datanode Uuid 385448d5-8b44-4919-8761-a52d18a9428f) service to localhost/127.0.0.1:34433 2023-09-13 03:01:49,861 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data3/current/BP-2056046563-172.31.2.10-1694573964554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 03:01:49,861 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data4/current/BP-2056046563-172.31.2.10-1694573964554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 03:01:49,862 WARN [Listener at jenkins-hbase9.apache.org/41229] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-13 03:01:49,864 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 03:01:49,966 WARN [BP-2056046563-172.31.2.10-1694573964554 heartbeating to localhost/127.0.0.1:34433] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-13 03:01:49,966 WARN [BP-2056046563-172.31.2.10-1694573964554 heartbeating to localhost/127.0.0.1:34433] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2056046563-172.31.2.10-1694573964554 (Datanode Uuid 20c46451-7dd1-43df-94a7-0eb0576b4e87) service to localhost/127.0.0.1:34433 2023-09-13 03:01:49,967 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data1/current/BP-2056046563-172.31.2.10-1694573964554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 03:01:49,967 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/df74caa5-ecef-7559-aa5a-6a395eef8efd/cluster_698764cd-03bd-3921-f986-26b07ade7b41/dfs/data/data2/current/BP-2056046563-172.31.2.10-1694573964554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-13 03:01:49,988 INFO [Listener at jenkins-hbase9.apache.org/41229] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-13 03:01:50,114 INFO [Listener at jenkins-hbase9.apache.org/41229] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-13 03:01:50,197 INFO [Listener at jenkins-hbase9.apache.org/41229] hbase.HBaseTestingUtility(1293): Minicluster is down