2023-07-14 08:12:14,464 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 08:12:14,732 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466 2023-07-14 08:12:14,732 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-14 08:12:14,732 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-14 08:12:14,787 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 08:12:15,110 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 08:12:15,111 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed, deleteOnExit=true 2023-07-14 08:12:15,111 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 08:12:15,111 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/test.cache.data in system properties and HBase conf 2023-07-14 08:12:15,112 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 08:12:15,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop.log.dir in system properties and HBase conf 2023-07-14 08:12:15,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 08:12:15,114 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 08:12:15,114 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 08:12:15,547 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 08:12:15,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:15,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:15,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 08:12:15,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:15,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 08:12:15,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 08:12:15,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:15,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:15,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 08:12:15,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/nfs.dump.dir in system properties and HBase conf 2023-07-14 08:12:15,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir in system properties and HBase conf 2023-07-14 08:12:15,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:15,561 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 08:12:15,561 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 08:12:16,304 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 08:12:16,309 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 08:12:16,663 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 08:12:16,884 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 08:12:16,907 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:16,973 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:17,027 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_localhost_37465_hdfs____.ae1ft3/webapp 2023-07-14 08:12:17,213 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37465 2023-07-14 08:12:17,226 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 08:12:17,226 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 08:12:17,838 WARN [Listener at localhost/43813] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:17,984 WARN [Listener at localhost/43813] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 08:12:18,090 WARN [Listener at localhost/43813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:18,100 INFO [Listener at localhost/43813] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:18,112 INFO [Listener at localhost/43813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_localhost_38963_datanode____bui1eg/webapp 2023-07-14 08:12:18,510 INFO [Listener at localhost/43813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38963 2023-07-14 08:12:19,335 WARN [Listener at localhost/34161] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:19,414 WARN [Listener at localhost/34161] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 08:12:19,417 WARN [Listener at localhost/34161] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:19,420 INFO [Listener at localhost/34161] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:19,436 INFO [Listener at localhost/34161] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_localhost_39407_datanode____.jgw32c/webapp 2023-07-14 08:12:19,562 INFO [Listener at localhost/34161] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39407 2023-07-14 08:12:19,581 WARN [Listener at localhost/45209] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:19,634 WARN [Listener at localhost/45209] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 08:12:19,637 WARN [Listener at localhost/45209] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:19,639 INFO [Listener at localhost/45209] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:19,648 INFO [Listener at localhost/45209] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_localhost_37395_datanode____.m10nhq/webapp 2023-07-14 08:12:19,793 INFO [Listener at localhost/45209] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37395 2023-07-14 08:12:19,818 WARN [Listener at localhost/33647] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 08:12:20,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87d8046372cfe0ca: Processing first storage report for DS-2de9e76d-7a30-494a-be3a-dfa834f63990 from datanode 2092b08a-4e3c-40ff-bf15-c4a32182e65d 2023-07-14 08:12:20,201 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87d8046372cfe0ca: from storage DS-2de9e76d-7a30-494a-be3a-dfa834f63990 node DatanodeRegistration(127.0.0.1:45575, datanodeUuid=2092b08a-4e3c-40ff-bf15-c4a32182e65d, infoPort=43747, infoSecurePort=0, ipcPort=45209, storageInfo=lv=-57;cid=testClusterID;nsid=1638080361;c=1689322336401), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,202 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c3b70ccac035e8f: Processing first storage report for DS-c1d90303-59b5-4fb2-a510-985e08bacd5e from datanode 601b63cf-b350-4bf2-864d-da8cee31a82b 2023-07-14 08:12:20,202 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c3b70ccac035e8f: from storage DS-c1d90303-59b5-4fb2-a510-985e08bacd5e node DatanodeRegistration(127.0.0.1:40981, datanodeUuid=601b63cf-b350-4bf2-864d-da8cee31a82b, infoPort=38785, infoSecurePort=0, ipcPort=34161, storageInfo=lv=-57;cid=testClusterID;nsid=1638080361;c=1689322336401), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,202 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x76fbb2e492c0af73: Processing first storage report for DS-c9d2b9dc-e376-48c4-baf9-46064a90c387 from datanode a9b348cb-b67d-4265-85d8-ea1d38f345d5 2023-07-14 08:12:20,202 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x76fbb2e492c0af73: from storage DS-c9d2b9dc-e376-48c4-baf9-46064a90c387 node DatanodeRegistration(127.0.0.1:46655, datanodeUuid=a9b348cb-b67d-4265-85d8-ea1d38f345d5, infoPort=40653, infoSecurePort=0, ipcPort=33647, storageInfo=lv=-57;cid=testClusterID;nsid=1638080361;c=1689322336401), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,202 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x87d8046372cfe0ca: Processing first storage report for DS-be920bbd-8ba0-4e09-b6d3-e8c0b1e33b9c from datanode 2092b08a-4e3c-40ff-bf15-c4a32182e65d 2023-07-14 08:12:20,203 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x87d8046372cfe0ca: from storage DS-be920bbd-8ba0-4e09-b6d3-e8c0b1e33b9c node DatanodeRegistration(127.0.0.1:45575, datanodeUuid=2092b08a-4e3c-40ff-bf15-c4a32182e65d, infoPort=43747, infoSecurePort=0, ipcPort=45209, storageInfo=lv=-57;cid=testClusterID;nsid=1638080361;c=1689322336401), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,203 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c3b70ccac035e8f: Processing first storage report for DS-7a809aad-1f86-49fd-9564-fe136718ea59 from datanode 601b63cf-b350-4bf2-864d-da8cee31a82b 2023-07-14 08:12:20,203 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c3b70ccac035e8f: from storage DS-7a809aad-1f86-49fd-9564-fe136718ea59 node DatanodeRegistration(127.0.0.1:40981, datanodeUuid=601b63cf-b350-4bf2-864d-da8cee31a82b, infoPort=38785, infoSecurePort=0, ipcPort=34161, storageInfo=lv=-57;cid=testClusterID;nsid=1638080361;c=1689322336401), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,203 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x76fbb2e492c0af73: Processing first storage report for DS-d166c626-2492-4bc9-b59b-48d6bc142112 from datanode a9b348cb-b67d-4265-85d8-ea1d38f345d5 2023-07-14 08:12:20,203 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x76fbb2e492c0af73: from storage DS-d166c626-2492-4bc9-b59b-48d6bc142112 node DatanodeRegistration(127.0.0.1:46655, datanodeUuid=a9b348cb-b67d-4265-85d8-ea1d38f345d5, infoPort=40653, infoSecurePort=0, ipcPort=33647, storageInfo=lv=-57;cid=testClusterID;nsid=1638080361;c=1689322336401), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 08:12:20,483 DEBUG [Listener at localhost/33647] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466 2023-07-14 08:12:20,584 INFO [Listener at localhost/33647] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/zookeeper_0, clientPort=53917, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 08:12:20,613 INFO [Listener at localhost/33647] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53917 2023-07-14 08:12:20,625 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:20,627 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:21,385 INFO [Listener at localhost/33647] util.FSUtils(471): Created version file at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c with version=8 2023-07-14 08:12:21,385 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/hbase-staging 2023-07-14 08:12:21,782 INFO [Listener at localhost/33647] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 08:12:22,406 INFO [Listener at localhost/33647] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:22,445 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:22,446 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:22,446 INFO [Listener at localhost/33647] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:22,446 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:22,447 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:22,614 INFO [Listener at localhost/33647] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:22,701 DEBUG [Listener at localhost/33647] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 08:12:22,852 INFO [Listener at localhost/33647] ipc.NettyRpcServer(120): Bind to /172.31.2.10:37597 2023-07-14 08:12:22,871 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:22,877 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:22,909 INFO [Listener at localhost/33647] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37597 connecting to ZooKeeper ensemble=127.0.0.1:53917 2023-07-14 08:12:22,976 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:375970x0, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:22,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37597-0x10162d6046a0000 connected 2023-07-14 08:12:23,038 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,039 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,054 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,063 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37597 2023-07-14 08:12:23,063 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37597 2023-07-14 08:12:23,064 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37597 2023-07-14 08:12:23,064 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37597 2023-07-14 08:12:23,065 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37597 2023-07-14 08:12:23,072 INFO [Listener at localhost/33647] master.HMaster(444): hbase.rootdir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, hbase.cluster.distributed=false 2023-07-14 08:12:23,154 INFO [Listener at localhost/33647] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:23,154 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,154 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,154 INFO [Listener at localhost/33647] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:23,154 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,155 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:23,160 INFO [Listener at localhost/33647] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:23,166 INFO [Listener at localhost/33647] ipc.NettyRpcServer(120): Bind to /172.31.2.10:39577 2023-07-14 08:12:23,169 INFO [Listener at localhost/33647] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 08:12:23,176 INFO [Listener at localhost/33647] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 08:12:23,177 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,179 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,182 INFO [Listener at localhost/33647] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39577 connecting to ZooKeeper ensemble=127.0.0.1:53917 2023-07-14 08:12:23,199 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:395770x0, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,200 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:395770x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,202 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:395770x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,203 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:395770x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39577-0x10162d6046a0001 connected 2023-07-14 08:12:23,217 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39577 2023-07-14 08:12:23,221 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39577 2023-07-14 08:12:23,225 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39577 2023-07-14 08:12:23,233 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39577 2023-07-14 08:12:23,236 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39577 2023-07-14 08:12:23,258 INFO [Listener at localhost/33647] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:23,259 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,259 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,259 INFO [Listener at localhost/33647] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:23,259 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,260 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:23,260 INFO [Listener at localhost/33647] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:23,268 INFO [Listener at localhost/33647] ipc.NettyRpcServer(120): Bind to /172.31.2.10:44291 2023-07-14 08:12:23,269 INFO [Listener at localhost/33647] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 08:12:23,275 INFO [Listener at localhost/33647] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 08:12:23,276 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,279 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,287 INFO [Listener at localhost/33647] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44291 connecting to ZooKeeper ensemble=127.0.0.1:53917 2023-07-14 08:12:23,293 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:442910x0, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,294 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:442910x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,295 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:442910x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,296 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:442910x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,304 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44291 2023-07-14 08:12:23,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44291-0x10162d6046a0002 connected 2023-07-14 08:12:23,305 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44291 2023-07-14 08:12:23,308 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44291 2023-07-14 08:12:23,313 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44291 2023-07-14 08:12:23,314 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44291 2023-07-14 08:12:23,330 INFO [Listener at localhost/33647] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 08:12:23,330 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,331 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,331 INFO [Listener at localhost/33647] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 08:12:23,331 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 08:12:23,331 INFO [Listener at localhost/33647] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 08:12:23,332 INFO [Listener at localhost/33647] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 08:12:23,334 INFO [Listener at localhost/33647] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38267 2023-07-14 08:12:23,334 INFO [Listener at localhost/33647] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 08:12:23,359 INFO [Listener at localhost/33647] mob.MobFileCache(124): MobFileCache disabled 2023-07-14 08:12:23,361 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,363 INFO [Listener at localhost/33647] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,365 INFO [Listener at localhost/33647] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38267 connecting to ZooKeeper ensemble=127.0.0.1:53917 2023-07-14 08:12:23,374 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:382670x0, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 08:12:23,375 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:382670x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:12:23,378 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:382670x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:12:23,379 DEBUG [Listener at localhost/33647] zookeeper.ZKUtil(164): regionserver:382670x0, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 08:12:23,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38267-0x10162d6046a0003 connected 2023-07-14 08:12:23,395 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38267 2023-07-14 08:12:23,395 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38267 2023-07-14 08:12:23,412 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38267 2023-07-14 08:12:23,416 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38267 2023-07-14 08:12:23,418 DEBUG [Listener at localhost/33647] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38267 2023-07-14 08:12:23,435 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:23,448 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 08:12:23,451 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:23,478 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,478 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,478 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,479 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 08:12:23,479 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:23,486 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 08:12:23,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 08:12:23,488 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,37597,1689322341574 from backup master directory 2023-07-14 08:12:23,493 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:23,493 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 08:12:23,494 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:23,494 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:23,499 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 08:12:23,506 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 08:12:23,654 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/hbase.id with ID: e3923360-7799-4727-b277-6de40118c221 2023-07-14 08:12:23,705 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 08:12:23,729 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:23,821 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2c51a5f4 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:23,867 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@590c5392, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:23,899 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:23,901 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 08:12:23,926 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 08:12:23,926 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 08:12:23,929 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 08:12:23,934 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 08:12:23,936 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:23,979 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store-tmp 2023-07-14 08:12:24,029 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:24,029 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 08:12:24,029 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,029 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 08:12:24,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,030 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:12:24,030 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 08:12:24,034 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/WALs/jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:24,063 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C37597%2C1689322341574, suffix=, logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/WALs/jenkins-hbase9.apache.org,37597,1689322341574, archiveDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/oldWALs, maxLogs=10 2023-07-14 08:12:24,138 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK] 2023-07-14 08:12:24,138 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK] 2023-07-14 08:12:24,138 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK] 2023-07-14 08:12:24,147 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 08:12:24,239 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/WALs/jenkins-hbase9.apache.org,37597,1689322341574/jenkins-hbase9.apache.org%2C37597%2C1689322341574.1689322344081 2023-07-14 08:12:24,239 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK], DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK], DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK]] 2023-07-14 08:12:24,240 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:24,241 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:24,245 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,247 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,334 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,344 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 08:12:24,383 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 08:12:24,400 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:24,409 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,411 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,434 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 08:12:24,439 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:24,442 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67018201, jitterRate=-0.00135098397731781}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:24,442 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 08:12:24,444 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 08:12:24,476 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 08:12:24,476 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 08:12:24,479 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 08:12:24,481 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-14 08:12:24,523 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 41 msec 2023-07-14 08:12:24,523 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 08:12:24,559 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 08:12:24,565 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 08:12:24,598 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 08:12:24,606 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 08:12:24,608 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 08:12:24,616 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 08:12:24,621 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 08:12:24,625 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,628 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 08:12:24,628 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 08:12:24,650 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 08:12:24,657 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,657 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,657 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,657 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,657 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 08:12:24,659 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,37597,1689322341574, sessionid=0x10162d6046a0000, setting cluster-up flag (Was=false) 2023-07-14 08:12:24,682 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,690 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 08:12:24,695 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:24,704 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:24,715 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 08:12:24,719 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:24,722 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp 2023-07-14 08:12:24,731 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(951): ClusterId : e3923360-7799-4727-b277-6de40118c221 2023-07-14 08:12:24,735 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(951): ClusterId : e3923360-7799-4727-b277-6de40118c221 2023-07-14 08:12:24,744 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(951): ClusterId : e3923360-7799-4727-b277-6de40118c221 2023-07-14 08:12:24,745 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 08:12:24,745 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 08:12:24,745 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 08:12:24,765 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 08:12:24,765 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 08:12:24,765 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 08:12:24,765 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 08:12:24,766 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 08:12:24,767 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 08:12:24,771 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 08:12:24,771 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 08:12:24,774 DEBUG [RS:0;jenkins-hbase9:39577] zookeeper.ReadOnlyZKClient(139): Connect 0x3abf3cc0 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:24,781 DEBUG [RS:1;jenkins-hbase9:44291] zookeeper.ReadOnlyZKClient(139): Connect 0x5aa8dcb4 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:24,784 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 08:12:24,795 DEBUG [RS:2;jenkins-hbase9:38267] zookeeper.ReadOnlyZKClient(139): Connect 0x6ecd2ede to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:24,826 DEBUG [RS:0;jenkins-hbase9:39577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3478d5e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:24,828 DEBUG [RS:0;jenkins-hbase9:39577] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@304757b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:12:24,830 DEBUG [RS:1;jenkins-hbase9:44291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@546f3991, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:24,830 DEBUG [RS:1;jenkins-hbase9:44291] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5050b7c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:12:24,863 DEBUG [RS:2;jenkins-hbase9:38267] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@600acd77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:24,863 DEBUG [RS:2;jenkins-hbase9:38267] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@643545ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:12:24,906 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:38267 2023-07-14 08:12:24,906 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:44291 2023-07-14 08:12:24,927 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:39577 2023-07-14 08:12:24,935 INFO [RS:1;jenkins-hbase9:44291] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 08:12:24,935 INFO [RS:2;jenkins-hbase9:38267] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 08:12:24,936 INFO [RS:0;jenkins-hbase9:39577] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 08:12:24,936 INFO [RS:0;jenkins-hbase9:39577] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 08:12:24,936 INFO [RS:2;jenkins-hbase9:38267] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 08:12:24,936 INFO [RS:1;jenkins-hbase9:44291] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 08:12:24,985 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 08:12:24,985 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 08:12:24,985 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 08:12:24,985 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 08:12:24,987 INFO [RS:1;jenkins-hbase9:44291] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:24,987 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 08:12:24,987 INFO [RS:0;jenkins-hbase9:39577] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:24,988 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 08:12:24,988 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:24,989 INFO [RS:2;jenkins-hbase9:38267] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:24,989 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 08:12:24,989 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 08:12:24,992 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:39577, startcode=1689322343153 2023-07-14 08:12:24,992 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:44291, startcode=1689322343258 2023-07-14 08:12:24,992 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:38267, startcode=1689322343329 2023-07-14 08:12:25,016 DEBUG [RS:2;jenkins-hbase9:38267] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 08:12:25,017 DEBUG [RS:1;jenkins-hbase9:44291] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 08:12:25,016 DEBUG [RS:0;jenkins-hbase9:39577] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 08:12:25,115 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:38781, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 08:12:25,115 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37361, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 08:12:25,118 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44273, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 08:12:25,132 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,152 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 08:12:25,153 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,154 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,172 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 08:12:25,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 08:12:25,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,173 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,174 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,180 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,181 WARN [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 08:12:25,181 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,182 WARN [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 08:12:25,182 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,182 WARN [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 08:12:25,191 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689322375191 2023-07-14 08:12:25,194 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 08:12:25,197 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 08:12:25,197 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 08:12:25,208 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 08:12:25,213 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:25,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 08:12:25,217 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 08:12:25,218 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 08:12:25,219 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 08:12:25,226 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,243 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 08:12:25,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 08:12:25,246 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 08:12:25,265 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 08:12:25,266 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 08:12:25,280 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689322345274,5,FailOnTimeoutGroup] 2023-07-14 08:12:25,282 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689322345280,5,FailOnTimeoutGroup] 2023-07-14 08:12:25,282 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:44291, startcode=1689322343258 2023-07-14 08:12:25,282 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,284 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 08:12:25,284 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:39577, startcode=1689322343153 2023-07-14 08:12:25,284 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,285 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 08:12:25,286 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,286 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,286 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:38267, startcode=1689322343329 2023-07-14 08:12:25,302 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,302 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,302 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 08:12:25,302 WARN [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-14 08:12:25,302 WARN [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 200 ms and then retrying. 2023-07-14 08:12:25,348 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:12:25,348 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43813 2023-07-14 08:12:25,348 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 08:12:25,361 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:12:25,363 DEBUG [RS:2;jenkins-hbase9:38267] zookeeper.ZKUtil(162): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,365 WARN [RS:2;jenkins-hbase9:38267] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:25,374 INFO [RS:2;jenkins-hbase9:38267] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:25,380 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,382 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,38267,1689322343329] 2023-07-14 08:12:25,401 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:25,403 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:25,403 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:12:25,436 DEBUG [RS:2;jenkins-hbase9:38267] zookeeper.ZKUtil(162): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,468 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 08:12:25,500 INFO [RS:2;jenkins-hbase9:38267] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 08:12:25,504 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:39577, startcode=1689322343153 2023-07-14 08:12:25,504 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,37597,1689322341574 with isa=jenkins-hbase9.apache.org/172.31.2.10:44291, startcode=1689322343258 2023-07-14 08:12:25,519 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,525 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:12:25,525 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43813 2023-07-14 08:12:25,525 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 08:12:25,526 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37597] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,532 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:25,534 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:12:25,535 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43813 2023-07-14 08:12:25,535 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 08:12:25,535 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:12:25,535 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:12:25,535 DEBUG [RS:1;jenkins-hbase9:44291] zookeeper.ZKUtil(162): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,536 WARN [RS:1;jenkins-hbase9:44291] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:25,536 INFO [RS:1;jenkins-hbase9:44291] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:25,543 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,44291,1689322343258] 2023-07-14 08:12:25,543 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,39577,1689322343153] 2023-07-14 08:12:25,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 08:12:25,546 DEBUG [RS:0;jenkins-hbase9:39577] zookeeper.ZKUtil(162): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,546 WARN [RS:0;jenkins-hbase9:39577] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 08:12:25,547 INFO [RS:0;jenkins-hbase9:39577] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:25,547 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/info 2023-07-14 08:12:25,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,551 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 08:12:25,552 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:25,553 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 08:12:25,554 DEBUG [RS:1;jenkins-hbase9:44291] zookeeper.ZKUtil(162): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,555 DEBUG [RS:0;jenkins-hbase9:39577] zookeeper.ZKUtil(162): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,555 DEBUG [RS:1;jenkins-hbase9:44291] zookeeper.ZKUtil(162): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,556 DEBUG [RS:1;jenkins-hbase9:44291] zookeeper.ZKUtil(162): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,557 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/rep_barrier 2023-07-14 08:12:25,557 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 08:12:25,558 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:25,558 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 08:12:25,559 DEBUG [RS:0;jenkins-hbase9:39577] zookeeper.ZKUtil(162): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,559 DEBUG [RS:0;jenkins-hbase9:39577] zookeeper.ZKUtil(162): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,560 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 08:12:25,563 DEBUG [RS:0;jenkins-hbase9:39577] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 08:12:25,563 INFO [RS:0;jenkins-hbase9:39577] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 08:12:25,568 INFO [RS:2;jenkins-hbase9:38267] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 08:12:25,561 INFO [RS:1;jenkins-hbase9:44291] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 08:12:25,594 INFO [RS:2;jenkins-hbase9:38267] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 08:12:25,595 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/table 2023-07-14 08:12:25,595 INFO [RS:1;jenkins-hbase9:44291] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 08:12:25,603 INFO [RS:0;jenkins-hbase9:39577] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 08:12:25,604 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 08:12:25,605 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 08:12:25,606 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:25,607 INFO [RS:0;jenkins-hbase9:39577] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 08:12:25,611 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,612 INFO [RS:1;jenkins-hbase9:44291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 08:12:25,612 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,613 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 08:12:25,614 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 08:12:25,618 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740 2023-07-14 08:12:25,619 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740 2023-07-14 08:12:25,625 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,625 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,625 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,625 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,626 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,626 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 08:12:25,625 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,627 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,628 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:2;jenkins-hbase9:38267] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,627 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,628 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,629 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,629 DEBUG [RS:0;jenkins-hbase9:39577] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,630 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,630 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 08:12:25,630 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,631 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,631 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,631 DEBUG [RS:1;jenkins-hbase9:44291] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 08:12:25,632 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 08:12:25,633 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,633 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,633 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,641 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,641 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,641 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,647 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,650 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,650 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,660 INFO [RS:1;jenkins-hbase9:44291] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 08:12:25,661 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:25,662 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71833524, jitterRate=0.07040292024612427}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 08:12:25,663 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 08:12:25,663 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 08:12:25,663 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 08:12:25,663 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 08:12:25,663 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 08:12:25,663 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 08:12:25,664 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 08:12:25,664 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 08:12:25,664 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,44291,1689322343258-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,660 INFO [RS:2;jenkins-hbase9:38267] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 08:12:25,682 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38267,1689322343329-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,698 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 08:12:25,698 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 08:12:25,700 INFO [RS:0;jenkins-hbase9:39577] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 08:12:25,700 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,39577,1689322343153-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:25,714 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 08:12:25,728 INFO [RS:1;jenkins-hbase9:44291] regionserver.Replication(203): jenkins-hbase9.apache.org,44291,1689322343258 started 2023-07-14 08:12:25,728 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,44291,1689322343258, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:44291, sessionid=0x10162d6046a0002 2023-07-14 08:12:25,728 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 08:12:25,728 DEBUG [RS:1;jenkins-hbase9:44291] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,729 DEBUG [RS:1;jenkins-hbase9:44291] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44291,1689322343258' 2023-07-14 08:12:25,729 DEBUG [RS:1;jenkins-hbase9:44291] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 08:12:25,730 DEBUG [RS:1;jenkins-hbase9:44291] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 08:12:25,730 INFO [RS:2;jenkins-hbase9:38267] regionserver.Replication(203): jenkins-hbase9.apache.org,38267,1689322343329 started 2023-07-14 08:12:25,730 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,38267,1689322343329, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:38267, sessionid=0x10162d6046a0003 2023-07-14 08:12:25,731 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 08:12:25,731 DEBUG [RS:2;jenkins-hbase9:38267] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,731 DEBUG [RS:2;jenkins-hbase9:38267] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38267,1689322343329' 2023-07-14 08:12:25,734 DEBUG [RS:2;jenkins-hbase9:38267] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 08:12:25,735 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 08:12:25,735 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 08:12:25,735 DEBUG [RS:1;jenkins-hbase9:44291] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:25,735 DEBUG [RS:1;jenkins-hbase9:44291] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,44291,1689322343258' 2023-07-14 08:12:25,735 DEBUG [RS:1;jenkins-hbase9:44291] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:25,736 DEBUG [RS:1;jenkins-hbase9:44291] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:25,737 DEBUG [RS:1;jenkins-hbase9:44291] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 08:12:25,737 INFO [RS:1;jenkins-hbase9:44291] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 08:12:25,737 INFO [RS:1;jenkins-hbase9:44291] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 08:12:25,740 DEBUG [RS:2;jenkins-hbase9:38267] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 08:12:25,742 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 08:12:25,742 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 08:12:25,745 INFO [RS:0;jenkins-hbase9:39577] regionserver.Replication(203): jenkins-hbase9.apache.org,39577,1689322343153 started 2023-07-14 08:12:25,746 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,39577,1689322343153, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:39577, sessionid=0x10162d6046a0001 2023-07-14 08:12:25,746 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 08:12:25,746 DEBUG [RS:0;jenkins-hbase9:39577] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,746 DEBUG [RS:0;jenkins-hbase9:39577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39577,1689322343153' 2023-07-14 08:12:25,746 DEBUG [RS:0;jenkins-hbase9:39577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 08:12:25,742 DEBUG [RS:2;jenkins-hbase9:38267] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:25,747 DEBUG [RS:2;jenkins-hbase9:38267] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,38267,1689322343329' 2023-07-14 08:12:25,748 DEBUG [RS:2;jenkins-hbase9:38267] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:25,748 DEBUG [RS:0;jenkins-hbase9:39577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 08:12:25,749 DEBUG [RS:2;jenkins-hbase9:38267] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:25,750 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 08:12:25,754 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 08:12:25,760 DEBUG [RS:2;jenkins-hbase9:38267] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 08:12:25,760 INFO [RS:2;jenkins-hbase9:38267] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 08:12:25,761 INFO [RS:2;jenkins-hbase9:38267] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 08:12:25,762 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 08:12:25,762 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 08:12:25,763 DEBUG [RS:0;jenkins-hbase9:39577] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:25,763 DEBUG [RS:0;jenkins-hbase9:39577] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,39577,1689322343153' 2023-07-14 08:12:25,763 DEBUG [RS:0;jenkins-hbase9:39577] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:25,764 DEBUG [RS:0;jenkins-hbase9:39577] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:25,765 DEBUG [RS:0;jenkins-hbase9:39577] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 08:12:25,765 INFO [RS:0;jenkins-hbase9:39577] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 08:12:25,765 INFO [RS:0;jenkins-hbase9:39577] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 08:12:25,859 INFO [RS:1;jenkins-hbase9:44291] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C44291%2C1689322343258, suffix=, logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,44291,1689322343258, archiveDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs, maxLogs=32 2023-07-14 08:12:25,869 INFO [RS:0;jenkins-hbase9:39577] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C39577%2C1689322343153, suffix=, logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,39577,1689322343153, archiveDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs, maxLogs=32 2023-07-14 08:12:25,878 INFO [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38267%2C1689322343329, suffix=, logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,38267,1689322343329, archiveDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs, maxLogs=32 2023-07-14 08:12:25,907 DEBUG [jenkins-hbase9:37597] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 08:12:25,914 DEBUG [jenkins-hbase9:37597] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:25,929 DEBUG [jenkins-hbase9:37597] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:25,933 DEBUG [jenkins-hbase9:37597] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:25,933 DEBUG [jenkins-hbase9:37597] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:25,933 DEBUG [jenkins-hbase9:37597] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:25,949 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38267,1689322343329, state=OPENING 2023-07-14 08:12:25,964 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 08:12:25,975 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK] 2023-07-14 08:12:25,975 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:25,977 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK] 2023-07-14 08:12:25,977 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK] 2023-07-14 08:12:25,977 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 08:12:25,990 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK] 2023-07-14 08:12:25,991 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK] 2023-07-14 08:12:25,992 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK] 2023-07-14 08:12:25,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:12:25,993 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK] 2023-07-14 08:12:25,994 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK] 2023-07-14 08:12:26,023 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK] 2023-07-14 08:12:26,034 INFO [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,38267,1689322343329/jenkins-hbase9.apache.org%2C38267%2C1689322343329.1689322345880 2023-07-14 08:12:26,035 DEBUG [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK], DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK], DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK]] 2023-07-14 08:12:26,041 INFO [RS:0;jenkins-hbase9:39577] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,39577,1689322343153/jenkins-hbase9.apache.org%2C39577%2C1689322343153.1689322345873 2023-07-14 08:12:26,041 DEBUG [RS:0;jenkins-hbase9:39577] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK], DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK], DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK]] 2023-07-14 08:12:26,042 INFO [RS:1;jenkins-hbase9:44291] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,44291,1689322343258/jenkins-hbase9.apache.org%2C44291%2C1689322343258.1689322345861 2023-07-14 08:12:26,053 DEBUG [RS:1;jenkins-hbase9:44291] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK], DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK], DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK]] 2023-07-14 08:12:26,218 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:26,221 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:12:26,232 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:12:26,256 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 08:12:26,257 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 08:12:26,262 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38267%2C1689322343329.meta, suffix=.meta, logDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,38267,1689322343329, archiveDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs, maxLogs=32 2023-07-14 08:12:26,306 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK] 2023-07-14 08:12:26,311 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK] 2023-07-14 08:12:26,314 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK] 2023-07-14 08:12:26,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/WALs/jenkins-hbase9.apache.org,38267,1689322343329/jenkins-hbase9.apache.org%2C38267%2C1689322343329.meta.1689322346263.meta 2023-07-14 08:12:26,329 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45575,DS-2de9e76d-7a30-494a-be3a-dfa834f63990,DISK], DatanodeInfoWithStorage[127.0.0.1:46655,DS-c9d2b9dc-e376-48c4-baf9-46064a90c387,DISK], DatanodeInfoWithStorage[127.0.0.1:40981,DS-c1d90303-59b5-4fb2-a510-985e08bacd5e,DISK]] 2023-07-14 08:12:26,330 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:26,331 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 08:12:26,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:26,334 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 08:12:26,336 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 08:12:26,338 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 08:12:26,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 08:12:26,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:26,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 08:12:26,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 08:12:26,362 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 08:12:26,365 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/info 2023-07-14 08:12:26,365 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/info 2023-07-14 08:12:26,366 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 08:12:26,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:26,369 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 08:12:26,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/rep_barrier 2023-07-14 08:12:26,371 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/rep_barrier 2023-07-14 08:12:26,371 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 08:12:26,372 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:26,373 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 08:12:26,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/table 2023-07-14 08:12:26,374 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/table 2023-07-14 08:12:26,375 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 08:12:26,376 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:26,378 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740 2023-07-14 08:12:26,381 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740 2023-07-14 08:12:26,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 08:12:26,387 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 08:12:26,394 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60351684, jitterRate=-0.1006898283958435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 08:12:26,396 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 08:12:26,410 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689322346208 2023-07-14 08:12:26,430 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 08:12:26,431 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,38267,1689322343329, state=OPEN 2023-07-14 08:12:26,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 08:12:26,435 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 08:12:26,435 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 08:12:26,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 08:12:26,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,38267,1689322343329 in 453 msec 2023-07-14 08:12:26,450 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 08:12:26,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 729 msec 2023-07-14 08:12:26,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4560 sec 2023-07-14 08:12:26,459 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689322346459, completionTime=-1 2023-07-14 08:12:26,459 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 08:12:26,460 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 08:12:26,540 DEBUG [hconnection-0x1ff3833c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:26,544 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:26,571 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 08:12:26,571 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689322406571 2023-07-14 08:12:26,571 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689322466571 2023-07-14 08:12:26,572 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 111 msec 2023-07-14 08:12:26,608 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37597,1689322341574-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,608 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37597,1689322341574-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,608 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37597,1689322341574-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,611 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:37597, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,612 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 08:12:26,630 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 08:12:26,644 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 08:12:26,646 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:26,659 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 08:12:26,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:26,667 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:26,696 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:26,699 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78 empty. 2023-07-14 08:12:26,702 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:26,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 08:12:27,165 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:27,167 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e428c041cc6e3fda05976246c4a8d78, NAME => 'hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:12:27,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:27,184 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8e428c041cc6e3fda05976246c4a8d78, disabling compactions & flushes 2023-07-14 08:12:27,184 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,185 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,185 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. after waiting 0 ms 2023-07-14 08:12:27,185 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,185 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,185 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8e428c041cc6e3fda05976246c4a8d78: 2023-07-14 08:12:27,190 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:27,205 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689322347193"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322347193"}]},"ts":"1689322347193"} 2023-07-14 08:12:27,237 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 08:12:27,239 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:27,245 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322347239"}]},"ts":"1689322347239"} 2023-07-14 08:12:27,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 08:12:27,256 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:27,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:27,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:27,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:27,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:27,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8e428c041cc6e3fda05976246c4a8d78, ASSIGN}] 2023-07-14 08:12:27,265 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8e428c041cc6e3fda05976246c4a8d78, ASSIGN 2023-07-14 08:12:27,267 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8e428c041cc6e3fda05976246c4a8d78, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44291,1689322343258; forceNewPlan=false, retain=false 2023-07-14 08:12:27,421 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 08:12:27,422 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8e428c041cc6e3fda05976246c4a8d78, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:27,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689322347422"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322347422"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322347422"}]},"ts":"1689322347422"} 2023-07-14 08:12:27,428 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8e428c041cc6e3fda05976246c4a8d78, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:12:27,583 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:27,584 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:12:27,588 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:12:27,594 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e428c041cc6e3fda05976246c4a8d78, NAME => 'hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:27,594 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. service=AccessControlService 2023-07-14 08:12:27,596 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:27,596 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:27,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,597 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,603 INFO [StoreOpener-8e428c041cc6e3fda05976246c4a8d78-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,611 DEBUG [StoreOpener-8e428c041cc6e3fda05976246c4a8d78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/info 2023-07-14 08:12:27,612 DEBUG [StoreOpener-8e428c041cc6e3fda05976246c4a8d78-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/info 2023-07-14 08:12:27,612 INFO [StoreOpener-8e428c041cc6e3fda05976246c4a8d78-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e428c041cc6e3fda05976246c4a8d78 columnFamilyName info 2023-07-14 08:12:27,614 INFO [StoreOpener-8e428c041cc6e3fda05976246c4a8d78-1] regionserver.HStore(310): Store=8e428c041cc6e3fda05976246c4a8d78/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:27,623 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,629 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,637 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:12:27,652 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:27,653 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8e428c041cc6e3fda05976246c4a8d78; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59105021, jitterRate=-0.1192665547132492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:27,653 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8e428c041cc6e3fda05976246c4a8d78: 2023-07-14 08:12:27,656 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78., pid=6, masterSystemTime=1689322347583 2023-07-14 08:12:27,661 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,661 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:12:27,663 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8e428c041cc6e3fda05976246c4a8d78, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:27,663 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689322347662"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322347662"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322347662"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322347662"}]},"ts":"1689322347662"} 2023-07-14 08:12:27,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 08:12:27,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8e428c041cc6e3fda05976246c4a8d78, server=jenkins-hbase9.apache.org,44291,1689322343258 in 239 msec 2023-07-14 08:12:27,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 08:12:27,678 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8e428c041cc6e3fda05976246c4a8d78, ASSIGN in 413 msec 2023-07-14 08:12:27,680 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:27,680 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322347680"}]},"ts":"1689322347680"} 2023-07-14 08:12:27,687 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 08:12:27,691 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:27,695 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.0450 sec 2023-07-14 08:12:27,764 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 08:12:27,766 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 08:12:27,766 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:27,796 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:27,800 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:27,818 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 08:12:27,850 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 08:12:27,861 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 53 msec 2023-07-14 08:12:27,873 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 08:12:27,887 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 08:12:27,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-07-14 08:12:27,914 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 08:12:27,918 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 08:12:27,918 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.424sec 2023-07-14 08:12:27,921 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 08:12:27,924 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 08:12:27,924 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 08:12:27,926 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37597,1689322341574-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 08:12:27,927 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,37597,1689322341574-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 08:12:27,953 DEBUG [Listener at localhost/33647] zookeeper.ReadOnlyZKClient(139): Connect 0x0193df40 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:27,956 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 08:12:27,959 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 08:12:27,965 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:27,966 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:27,970 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 08:12:27,975 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:27,977 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239 empty. 2023-07-14 08:12:27,979 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:27,980 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 08:12:27,980 DEBUG [Listener at localhost/33647] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d3405b7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:27,980 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:28,011 DEBUG [hconnection-0x6b989be3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:28,021 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:28,024 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => ae7a8501ef028de2d71b7904f49b7239, NAME => 'hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:12:28,034 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:47932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:28,047 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:12:28,048 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 08:12:28,048 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/test.cache.data in system properties and HBase conf 2023-07-14 08:12:28,049 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 08:12:28,049 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop.log.dir in system properties and HBase conf 2023-07-14 08:12:28,050 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 08:12:28,050 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 08:12:28,050 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 08:12:28,050 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:28,050 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 08:12:28,050 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 08:12:28,051 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/nfs.dump.dir in system properties and HBase conf 2023-07-14 08:12:28,052 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir in system properties and HBase conf 2023-07-14 08:12:28,052 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 08:12:28,052 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 08:12:28,052 INFO [Listener at localhost/33647] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 08:12:28,087 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:28,121 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:28,121 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing ae7a8501ef028de2d71b7904f49b7239, disabling compactions & flushes 2023-07-14 08:12:28,122 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,122 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,122 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. after waiting 0 ms 2023-07-14 08:12:28,122 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,122 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,122 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for ae7a8501ef028de2d71b7904f49b7239: 2023-07-14 08:12:28,127 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:28,129 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689322348128"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322348128"}]},"ts":"1689322348128"} 2023-07-14 08:12:28,132 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 08:12:28,133 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:28,134 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322348134"}]},"ts":"1689322348134"} 2023-07-14 08:12:28,137 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 08:12:28,163 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:28,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:28,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:28,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:28,188 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:28,188 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ae7a8501ef028de2d71b7904f49b7239, ASSIGN}] 2023-07-14 08:12:28,192 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=ae7a8501ef028de2d71b7904f49b7239, ASSIGN 2023-07-14 08:12:28,195 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=ae7a8501ef028de2d71b7904f49b7239, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38267,1689322343329; forceNewPlan=false, retain=false 2023-07-14 08:12:28,289 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:28,345 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 08:12:28,347 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ae7a8501ef028de2d71b7904f49b7239, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:28,348 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689322348347"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322348347"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322348347"}]},"ts":"1689322348347"} 2023-07-14 08:12:28,351 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure ae7a8501ef028de2d71b7904f49b7239, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:12:28,514 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ae7a8501ef028de2d71b7904f49b7239, NAME => 'hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:12:28,515 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. service=AccessControlService 2023-07-14 08:12:28,515 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:28,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:28,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,516 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,519 INFO [StoreOpener-ae7a8501ef028de2d71b7904f49b7239-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,522 DEBUG [StoreOpener-ae7a8501ef028de2d71b7904f49b7239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/l 2023-07-14 08:12:28,522 DEBUG [StoreOpener-ae7a8501ef028de2d71b7904f49b7239-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/l 2023-07-14 08:12:28,522 INFO [StoreOpener-ae7a8501ef028de2d71b7904f49b7239-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ae7a8501ef028de2d71b7904f49b7239 columnFamilyName l 2023-07-14 08:12:28,523 INFO [StoreOpener-ae7a8501ef028de2d71b7904f49b7239-1] regionserver.HStore(310): Store=ae7a8501ef028de2d71b7904f49b7239/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:28,525 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,534 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:12:28,548 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:28,549 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened ae7a8501ef028de2d71b7904f49b7239; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74825428, jitterRate=0.11498576402664185}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:28,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for ae7a8501ef028de2d71b7904f49b7239: 2023-07-14 08:12:28,554 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239., pid=11, masterSystemTime=1689322348506 2023-07-14 08:12:28,558 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,558 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:12:28,562 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=ae7a8501ef028de2d71b7904f49b7239, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:28,562 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689322348562"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322348562"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322348562"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322348562"}]},"ts":"1689322348562"} 2023-07-14 08:12:28,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 08:12:28,571 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure ae7a8501ef028de2d71b7904f49b7239, server=jenkins-hbase9.apache.org,38267,1689322343329 in 215 msec 2023-07-14 08:12:28,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 08:12:28,575 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=ae7a8501ef028de2d71b7904f49b7239, ASSIGN in 383 msec 2023-07-14 08:12:28,577 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:28,577 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322348577"}]},"ts":"1689322348577"} 2023-07-14 08:12:28,581 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 08:12:28,588 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:28,589 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:28,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 631 msec 2023-07-14 08:12:29,089 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 08:12:29,090 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 08:12:29,115 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 08:12:29,585 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:29,971 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:29,979 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_41721_jobhistory____zf0na5/webapp 2023-07-14 08:12:30,167 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 08:12:30,167 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:30,167 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:30,171 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:30,267 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:30,712 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:31,230 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 08:12:31,263 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:41721 2023-07-14 08:12:31,963 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:12:32,297 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 08:12:32,298 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 08:12:32,300 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 08:12:32,304 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:32,305 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 08:12:32,305 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:32,305 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 08:12:32,306 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 08:12:32,306 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 08:12:32,306 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:12:32,306 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 08:12:32,306 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 08:12:32,306 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 08:12:32,577 WARN [Listener at jenkins-hbase9.apache.org/40167] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:32,676 WARN [Listener at jenkins-hbase9.apache.org/40167] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 08:12:32,677 INFO [Listener at jenkins-hbase9.apache.org/40167] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:32,689 INFO [Listener at jenkins-hbase9.apache.org/40167] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_38701_cluster____xlpil2/webapp 2023-07-14 08:12:32,789 INFO [Listener at jenkins-hbase9.apache.org/40167] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:32,789 INFO [Listener at jenkins-hbase9.apache.org/40167] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 08:12:32,790 INFO [Listener at jenkins-hbase9.apache.org/40167] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:32,790 INFO [Listener at jenkins-hbase9.apache.org/40167] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:32,803 INFO [Listener at jenkins-hbase9.apache.org/40167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,065 INFO [Listener at jenkins-hbase9.apache.org/40167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,188 INFO [Listener at jenkins-hbase9.apache.org/40167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,203 INFO [Listener at jenkins-hbase9.apache.org/40167] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:38701 2023-07-14 08:12:33,733 WARN [Listener at jenkins-hbase9.apache.org/44863] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:33,763 WARN [Listener at jenkins-hbase9.apache.org/44863] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 08:12:33,764 INFO [Listener at jenkins-hbase9.apache.org/44863] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:33,773 INFO [Listener at jenkins-hbase9.apache.org/44863] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46115_node____luqmgc/webapp 2023-07-14 08:12:33,834 INFO [Listener at jenkins-hbase9.apache.org/44863] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 08:12:33,835 INFO [Listener at jenkins-hbase9.apache.org/44863] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:33,835 INFO [Listener at jenkins-hbase9.apache.org/44863] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:33,835 INFO [Listener at jenkins-hbase9.apache.org/44863] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:33,848 INFO [Listener at jenkins-hbase9.apache.org/44863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:33,906 INFO [Listener at jenkins-hbase9.apache.org/44863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,067 INFO [Listener at jenkins-hbase9.apache.org/44863] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,093 INFO [Listener at jenkins-hbase9.apache.org/44863] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46115 2023-07-14 08:12:34,469 WARN [Listener at jenkins-hbase9.apache.org/33489] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 08:12:34,479 WARN [Listener at jenkins-hbase9.apache.org/33489] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 08:12:34,480 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 08:12:34,494 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_39197_node____icvmbm/webapp 2023-07-14 08:12:34,585 INFO [Listener at jenkins-hbase9.apache.org/33489] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 08:12:34,585 INFO [Listener at jenkins-hbase9.apache.org/33489] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 08:12:34,585 INFO [Listener at jenkins-hbase9.apache.org/33489] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 08:12:34,585 INFO [Listener at jenkins-hbase9.apache.org/33489] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 08:12:34,600 INFO [Listener at jenkins-hbase9.apache.org/33489] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,623 INFO [Listener at jenkins-hbase9.apache.org/33489] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,718 INFO [Listener at jenkins-hbase9.apache.org/33489] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 08:12:34,740 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:39197 2023-07-14 08:12:34,799 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 08:12:34,801 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:34,879 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=647, ProcessCount=183, AvailableMemoryMB=2650 2023-07-14 08:12:34,879 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-07-14 08:12:34,898 DEBUG [Listener at jenkins-hbase9.apache.org/33489] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 08:12:34,907 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 08:12:34,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 08:12:34,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:34,925 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:12:34,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 08:12:34,929 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:12:34,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:34,940 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:34,940 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:34,941 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 empty. 2023-07-14 08:12:34,941 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 empty. 2023-07-14 08:12:34,946 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:34,946 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:34,946 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 08:12:34,996 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 08:12:34,999 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => fc5bd246c38ce5165bd7cf028fdbb008, NAME => 'testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:12:35,002 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4412465e6a0d82836c22d59edee2e0c2, NAME => 'testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:12:35,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,067 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,068 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing fc5bd246c38ce5165bd7cf028fdbb008, disabling compactions & flushes 2023-07-14 08:12:35,068 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,068 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,068 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. after waiting 0 ms 2023-07-14 08:12:35,068 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,068 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,068 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for fc5bd246c38ce5165bd7cf028fdbb008: 2023-07-14 08:12:35,084 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 4412465e6a0d82836c22d59edee2e0c2, disabling compactions & flushes 2023-07-14 08:12:35,085 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. after waiting 0 ms 2023-07-14 08:12:35,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,085 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,085 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 4412465e6a0d82836c22d59edee2e0c2: 2023-07-14 08:12:35,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:12:35,093 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322355093"}]},"ts":"1689322355093"} 2023-07-14 08:12:35,093 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322355093"}]},"ts":"1689322355093"} 2023-07-14 08:12:35,158 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:12:35,160 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:12:35,160 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322355160"}]},"ts":"1689322355160"} 2023-07-14 08:12:35,162 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 08:12:35,167 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:12:35,172 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:12:35,172 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:12:35,172 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:12:35,172 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:12:35,173 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, ASSIGN}] 2023-07-14 08:12:35,177 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, ASSIGN 2023-07-14 08:12:35,177 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, ASSIGN 2023-07-14 08:12:35,179 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39577,1689322343153; forceNewPlan=false, retain=false 2023-07-14 08:12:35,179 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44291,1689322343258; forceNewPlan=false, retain=false 2023-07-14 08:12:35,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,330 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:12:35,332 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4412465e6a0d82836c22d59edee2e0c2, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:35,332 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fc5bd246c38ce5165bd7cf028fdbb008, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:35,332 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322355332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322355332"}]},"ts":"1689322355332"} 2023-07-14 08:12:35,333 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355332"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322355332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322355332"}]},"ts":"1689322355332"} 2023-07-14 08:12:35,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 4412465e6a0d82836c22d59edee2e0c2, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:12:35,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure fc5bd246c38ce5165bd7cf028fdbb008, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:12:35,495 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:35,495 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:12:35,506 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:12:35,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4412465e6a0d82836c22d59edee2e0c2, NAME => 'testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:12:35,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. service=AccessControlService 2023-07-14 08:12:35,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:35,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fc5bd246c38ce5165bd7cf028fdbb008, NAME => 'testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:12:35,519 INFO [StoreOpener-4412465e6a0d82836c22d59edee2e0c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,521 DEBUG [StoreOpener-4412465e6a0d82836c22d59edee2e0c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf 2023-07-14 08:12:35,521 DEBUG [StoreOpener-4412465e6a0d82836c22d59edee2e0c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf 2023-07-14 08:12:35,525 INFO [StoreOpener-4412465e6a0d82836c22d59edee2e0c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4412465e6a0d82836c22d59edee2e0c2 columnFamilyName cf 2023-07-14 08:12:35,532 INFO [StoreOpener-4412465e6a0d82836c22d59edee2e0c2-1] regionserver.HStore(310): Store=4412465e6a0d82836c22d59edee2e0c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:35,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. service=AccessControlService 2023-07-14 08:12:35,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:12:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:12:35,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,544 INFO [StoreOpener-fc5bd246c38ce5165bd7cf028fdbb008-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:12:35,547 DEBUG [StoreOpener-fc5bd246c38ce5165bd7cf028fdbb008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf 2023-07-14 08:12:35,547 DEBUG [StoreOpener-fc5bd246c38ce5165bd7cf028fdbb008-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf 2023-07-14 08:12:35,548 INFO [StoreOpener-fc5bd246c38ce5165bd7cf028fdbb008-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fc5bd246c38ce5165bd7cf028fdbb008 columnFamilyName cf 2023-07-14 08:12:35,559 INFO [StoreOpener-fc5bd246c38ce5165bd7cf028fdbb008-1] regionserver.HStore(310): Store=fc5bd246c38ce5165bd7cf028fdbb008/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:12:35,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,579 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,580 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:35,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4412465e6a0d82836c22d59edee2e0c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66867377, jitterRate=-0.003598436713218689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:35,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4412465e6a0d82836c22d59edee2e0c2: 2023-07-14 08:12:35,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:35,585 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2., pid=15, masterSystemTime=1689322355491 2023-07-14 08:12:35,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:12:35,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:35,590 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=4412465e6a0d82836c22d59edee2e0c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:35,591 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355590"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322355590"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322355590"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322355590"}]},"ts":"1689322355590"} 2023-07-14 08:12:35,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-14 08:12:35,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 4412465e6a0d82836c22d59edee2e0c2, server=jenkins-hbase9.apache.org,44291,1689322343258 in 263 msec 2023-07-14 08:12:35,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:12:35,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened fc5bd246c38ce5165bd7cf028fdbb008; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70716529, jitterRate=0.053758397698402405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:12:35,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for fc5bd246c38ce5165bd7cf028fdbb008: 2023-07-14 08:12:35,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, ASSIGN in 443 msec 2023-07-14 08:12:35,622 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008., pid=16, masterSystemTime=1689322355495 2023-07-14 08:12:35,631 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=fc5bd246c38ce5165bd7cf028fdbb008, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:35,631 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322355631"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322355631"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322355631"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322355631"}]},"ts":"1689322355631"} 2023-07-14 08:12:35,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:35,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-14 08:12:35,659 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure fc5bd246c38ce5165bd7cf028fdbb008, server=jenkins-hbase9.apache.org,39577,1689322343153 in 298 msec 2023-07-14 08:12:35,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-14 08:12:35,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, ASSIGN in 483 msec 2023-07-14 08:12:35,662 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:12:35,662 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322355662"}]},"ts":"1689322355662"} 2023-07-14 08:12:35,665 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 08:12:35,672 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:12:35,679 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 08:12:35,704 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 08:12:35,743 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,743 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,744 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,743 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 08:12:35,744 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:12:35,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,751 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 08:12:35,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 834 msec 2023-07-14 08:12:36,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 08:12:36,086 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 08:12:36,090 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 08:12:36,091 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:36,094 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:36,136 DEBUG [hconnection-0x6b989be3-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,144 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:58394, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,154 DEBUG [hconnection-0x6b989be3-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,158 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322356175 (current time:1689322356175). 2023-07-14 08:12:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:12:36,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x7d808695 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:36,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@574987d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:36,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,188 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d808695 to 127.0.0.1:53917 2023-07-14 08:12:36,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:36,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x130778df to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:36,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4749af66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:36,297 DEBUG [hconnection-0x24630da-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:36,298 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:36,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x130778df to 127.0.0.1:53917 2023-07-14 08:12:36,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:36,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 08:12:36,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:12:36,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,369 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,371 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689322956371 2023-07-14 08:12:36,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:36,372 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 08:12:36,376 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:36,378 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,383 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:12:36,383 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:12:36,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-14 08:12:36,385 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,386 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689322956386 2023-07-14 08:12:36,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,454 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 08:12:36,454 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,455 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 08:12:36,456 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 08:12:36,456 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,456 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,461 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,461 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,461 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,461 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,462 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,462 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,463 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,463 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 08:12:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:36,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,469 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,469 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,469 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:36,469 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,469 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,469 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:36,471 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,470 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,472 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,472 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:36,472 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,472 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,472 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:36,473 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,473 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:36,477 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,478 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,478 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,478 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,479 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,479 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,480 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,480 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,480 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,480 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f77157[Count = 1] remaining members to acquire global barrier 2023-07-14 08:12:36,483 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:36,489 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:12:36,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:36,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@69f77157[Count = 0] remaining members to acquire global barrier 2023-07-14 08:12:36,489 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 08:12:36,489 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,494 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,495 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:12:36,494 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,495 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:36,495 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,496 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,496 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:12:36,497 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:36,498 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:36,498 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:36,498 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. started... 2023-07-14 08:12:36,501 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc5bd246c38ce5165bd7cf028fdbb008: 2023-07-14 08:12:36,501 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:36,501 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:36,501 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:36,502 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. started... 2023-07-14 08:12:36,503 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,505 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,506 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,506 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:36,511 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4412465e6a0d82836c22d59edee2e0c2: 2023-07-14 08:12:36,511 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,516 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:36,516 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:36,522 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:12:36,522 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:12:36,610 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. completed. 2023-07-14 08:12:36,610 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:36,610 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:36,611 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:36,611 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,611 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,611 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:12:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,620 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,620 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:36,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,629 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. completed. 2023-07-14 08:12:36,629 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:36,629 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:36,629 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:36,629 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,629 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:36,629 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:12:36,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:12:36,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 08:12:36,634 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:36,634 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,634 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:36,634 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:12:36,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 08:12:36,642 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 08:12:36,642 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:12:36,642 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:12:36,642 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,642 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,646 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,647 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:36,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,647 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,648 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:36,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,652 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:36,652 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,653 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:36,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:36,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:36,669 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:36,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:36,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:36,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:36,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:36,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:36,678 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:36,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,679 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 08:12:36,679 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:12:36,681 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 08:12:36,689 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:36,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:36,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:36,691 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:12:36,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,813 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,906 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 08:12:36,906 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,910 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 08:12:36,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689322356372Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689322356709 (+337 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689322356709Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689322356710 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689322356748 (+38 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689322356800 (+52 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689322356906 (+106 ms) 2023-07-14 08:12:36,913 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:36,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 537 msec 2023-07-14 08:12:36,992 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:36,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:36,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:12:37,011 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39577] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:12:37,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44291] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:12:37,018 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 08:12:37,019 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:37,019 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:12:37,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:37,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322357044 (current time:1689322357044). 2023-07-14 08:12:37,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:12:37,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x69f9001f to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a82556a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:37,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:37,067 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69f9001f to 127.0.0.1:53917 2023-07-14 08:12:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:37,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x6c0c5bfb to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:12:37,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4dd4579d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:12:37,104 DEBUG [hconnection-0x75c57248-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:12:37,109 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:12:37,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c0c5bfb to 127.0.0.1:53917 2023-07-14 08:12:37,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:12:37,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 08:12:37,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:12:37,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:37,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:37,121 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:37,124 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689322957124 2023-07-14 08:12:37,124 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 08:12:37,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 08:12:37,126 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:12:37,126 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:12:37,128 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 08:12:37,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:37,130 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-14 08:12:37,132 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:37,133 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689322957133 2023-07-14 08:12:37,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 08:12:37,179 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 08:12:37,179 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:37,180 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 08:12:37,180 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 08:12:37,181 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,181 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,183 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:37,183 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:37,183 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:37,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:37,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:37,183 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,184 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 08:12:37,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,185 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:37,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 08:12:37,186 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:37,186 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:37,187 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:37,187 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:37,188 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,188 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:37,188 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,188 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:12:37,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 08:12:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 08:12:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,191 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,191 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:37,191 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 08:12:37,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 08:12:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:37,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 08:12:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:37,192 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 08:12:37,193 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:12:37,193 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 08:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 08:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 08:12:37,196 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,196 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:37,199 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:37,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,200 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:12:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ce49cb3[Count = 1] remaining members to acquire global barrier 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:37,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:37,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 08:12:37,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ce49cb3[Count = 0] remaining members to acquire global barrier 2023-07-14 08:12:37,205 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 08:12:37,205 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:37,211 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:37,211 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 08:12:37,211 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. started... 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:12:37,211 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:12:37,211 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:37,211 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. started... 2023-07-14 08:12:37,211 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,212 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:12:37,212 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4412465e6a0d82836c22d59edee2e0c2 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 08:12:37,212 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fc5bd246c38ce5165bd7cf028fdbb008 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 08:12:37,214 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:37,214 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:37,214 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:37,226 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:37,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:37,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:37,229 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:12:37,380 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714b77a0cac4076478dab00064a67636451 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714b77a0cac4076478dab00064a67636451 2023-07-14 08:12:37,411 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/.tmp/cf/2f02f653044f48ebbc0eb0eeba824b36 2023-07-14 08:12:37,423 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/.tmp/cf/2f02f653044f48ebbc0eb0eeba824b36 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf/2f02f653044f48ebbc0eb0eeba824b36 2023-07-14 08:12:37,429 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:37,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:37,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:37,434 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:12:37,434 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf/2f02f653044f48ebbc0eb0eeba824b36, entries=4, sequenceid=6, filesize=5.6 K 2023-07-14 08:12:37,437 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for fc5bd246c38ce5165bd7cf028fdbb008 in 225ms, sequenceid=6, compaction requested=false 2023-07-14 08:12:37,437 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 08:12:37,438 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fc5bd246c38ce5165bd7cf028fdbb008: 2023-07-14 08:12:37,439 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:37,439 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:37,439 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf/2f02f653044f48ebbc0eb0eeba824b36] hfiles 2023-07-14 08:12:37,439 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf/2f02f653044f48ebbc0eb0eeba824b36 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:37,477 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. completed. 2023-07-14 08:12:37,477 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:12:37,477 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:37,477 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:37,477 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,477 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:37,477 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:12:37,480 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,480 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:37,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:37,480 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:37,480 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:37,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:37,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:37,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:37,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:37,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:12:37,487 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 08:12:37,734 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:37,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:37,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:37,737 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:12:37,744 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071472dc63ade36b45be94fd611b79a1da3f to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071472dc63ade36b45be94fd611b79a1da3f 2023-07-14 08:12:38,192 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/.tmp/cf/ba4358601de0412c86dce5c2ac21490b 2023-07-14 08:12:38,204 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/.tmp/cf/ba4358601de0412c86dce5c2ac21490b as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf/ba4358601de0412c86dce5c2ac21490b 2023-07-14 08:12:38,229 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf/ba4358601de0412c86dce5c2ac21490b, entries=46, sequenceid=6, filesize=12.6 K 2023-07-14 08:12:38,232 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4412465e6a0d82836c22d59edee2e0c2 in 1021ms, sequenceid=6, compaction requested=false 2023-07-14 08:12:38,235 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4412465e6a0d82836c22d59edee2e0c2: 2023-07-14 08:12:38,236 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:38,236 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:12:38,236 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf/ba4358601de0412c86dce5c2ac21490b] hfiles 2023-07-14 08:12:38,236 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf/ba4358601de0412c86dce5c2ac21490b for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:38,237 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:38,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:38,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:12:38,248 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 08:12:38,357 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. completed. 2023-07-14 08:12:38,357 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:12:38,358 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:12:38,358 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:12:38,358 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,358 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 08:12:38,358 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:12:38,360 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:38,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:38,361 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 08:12:38,361 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:38,361 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 08:12:38,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:38,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:38,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:38,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:12:38,376 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 08:12:38,376 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 08:12:38,376 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:12:38,376 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:12:38,376 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 08:12:38,376 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:12:38,378 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,378 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:38,378 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,378 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,378 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:38,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:12:38,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:12:38,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:12:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:38,379 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:38,380 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,382 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:38,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:38,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:12:38,382 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:38,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:12:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 08:12:38,387 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,387 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,388 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,407 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:38,407 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:38,407 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:38,407 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:38,407 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:12:38,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:38,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:38,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 08:12:38,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:38,408 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:12:38,408 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:12:38,408 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,408 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-14 08:12:38,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 08:12:38,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:12:38,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:38,409 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,410 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,410 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,410 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,410 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:38,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:38,410 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,411 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:12:38,411 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:38,411 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,411 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:38,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:12:38,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:12:38,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071472dc63ade36b45be94fd611b79a1da3f, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714b77a0cac4076478dab00064a67636451] mob files 2023-07-14 08:12:38,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071472dc63ade36b45be94fd611b79a1da3f 2023-07-14 08:12:38,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714b77a0cac4076478dab00064a67636451 2023-07-14 08:12:38,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:12:38,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:12:38,531 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 08:12:38,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,736 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 08:12:38,736 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,737 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 08:12:38,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689322357124Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689322358531 (+1407 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689322358531Loading Region manifests for snaptb0-testExportWithTargetName at 1689322358531Writing data manifest for snaptb0-testExportWithTargetName at 1689322358553 (+22 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689322358624 (+71 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689322358736 (+112 ms) 2023-07-14 08:12:38,740 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 08:12:38,743 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.6140 sec 2023-07-14 08:12:39,248 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:12:39,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 08:12:39,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:12:39,254 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254 2023-07-14 08:12:39,254 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43813, tgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254, rawTgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:12:39,314 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:12:39,314 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-924695992_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 08:12:39,314 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 08:12:39,360 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 08:12:39,618 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:39,619 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:39,620 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:39,620 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,852 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-8929263827685688091.jar 2023-07-14 08:12:40,852 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,853 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,942 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-940532690610903585.jar 2023-07-14 08:12:40,943 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,943 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,944 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,944 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,945 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,945 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:12:40,946 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:12:40,947 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:12:40,947 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:12:40,948 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:12:40,948 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:12:40,949 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:12:40,949 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:12:40,950 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:12:40,950 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:12:40,951 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:12:40,956 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,957 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,957 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:12:40,958 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,958 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:12:40,959 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:12:40,959 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:12:41,036 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:12:43,621 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:12:43,629 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 08:12:43,639 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 08:12:44,307 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:12:44,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:12:44,600 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:50,716 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:53,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:58,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0001_000001 (auth:SIMPLE) 2023-07-14 08:12:59,736 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:12:59,738 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:12:59,760 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 08:12:59,760 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:12:59,762 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:12:59,762 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 08:12:59,764 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 08:12:59,764 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 08:12:59,764 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254/.hbase-snapshot/testExportWithTargetName 2023-07-14 08:12:59,765 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 08:12:59,765 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322359254/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 08:12:59,797 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 08:12:59,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 08:12:59,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:12:59,821 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322379821"}]},"ts":"1689322379821"} 2023-07-14 08:12:59,824 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 08:12:59,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 08:12:59,826 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 08:12:59,829 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, UNASSIGN}] 2023-07-14 08:12:59,831 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, UNASSIGN 2023-07-14 08:12:59,832 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, UNASSIGN 2023-07-14 08:12:59,834 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=fc5bd246c38ce5165bd7cf028fdbb008, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:12:59,834 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4412465e6a0d82836c22d59edee2e0c2, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:12:59,834 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322379834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322379834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322379834"}]},"ts":"1689322379834"} 2023-07-14 08:12:59,834 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322379834"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322379834"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322379834"}]},"ts":"1689322379834"} 2023-07-14 08:12:59,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure fc5bd246c38ce5165bd7cf028fdbb008, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:12:59,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 4412465e6a0d82836c22d59edee2e0c2, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:12:59,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 08:13:00,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:13:00,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4412465e6a0d82836c22d59edee2e0c2, disabling compactions & flushes 2023-07-14 08:13:00,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:13:00,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:13:00,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. after waiting 0 ms 2023-07-14 08:13:00,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:13:00,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:13:00,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing fc5bd246c38ce5165bd7cf028fdbb008, disabling compactions & flushes 2023-07-14 08:13:00,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:13:00,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:13:00,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. after waiting 0 ms 2023-07-14 08:13:00,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:13:00,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:13:00,021 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:13:00,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:13:00,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:13:00,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2. 2023-07-14 08:13:00,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008. 2023-07-14 08:13:00,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for fc5bd246c38ce5165bd7cf028fdbb008: 2023-07-14 08:13:00,024 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4412465e6a0d82836c22d59edee2e0c2: 2023-07-14 08:13:00,026 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:13:00,027 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=fc5bd246c38ce5165bd7cf028fdbb008, regionState=CLOSED 2023-07-14 08:13:00,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:13:00,027 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322380027"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322380027"}]},"ts":"1689322380027"} 2023-07-14 08:13:00,028 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=4412465e6a0d82836c22d59edee2e0c2, regionState=CLOSED 2023-07-14 08:13:00,029 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689322380028"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322380028"}]},"ts":"1689322380028"} 2023-07-14 08:13:00,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-14 08:13:00,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure fc5bd246c38ce5165bd7cf028fdbb008, server=jenkins-hbase9.apache.org,39577,1689322343153 in 193 msec 2023-07-14 08:13:00,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-14 08:13:00,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 4412465e6a0d82836c22d59edee2e0c2, server=jenkins-hbase9.apache.org,44291,1689322343258 in 198 msec 2023-07-14 08:13:00,045 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fc5bd246c38ce5165bd7cf028fdbb008, UNASSIGN in 213 msec 2023-07-14 08:13:00,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-14 08:13:00,047 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4412465e6a0d82836c22d59edee2e0c2, UNASSIGN in 214 msec 2023-07-14 08:13:00,049 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322380049"}]},"ts":"1689322380049"} 2023-07-14 08:13:00,053 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 08:13:00,055 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 08:13:00,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 248 msec 2023-07-14 08:13:00,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 08:13:00,126 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 08:13:00,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 08:13:00,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:13:00,143 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:13:00,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 08:13:00,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:13:00,149 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 08:13:00,152 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:13:00,152 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:13:00,152 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:13:00,152 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 08:13:00,152 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:13:00,154 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,154 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,154 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,154 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,154 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:13:00,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 08:13:00,155 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:13:00,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 08:13:00,156 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:13:00,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 08:13:00,156 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:13:00,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 08:13:00,156 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:13:00,158 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/recovered.edits] 2023-07-14 08:13:00,158 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/recovered.edits] 2023-07-14 08:13:00,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 08:13:00,166 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf/ba4358601de0412c86dce5c2ac21490b to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/cf/ba4358601de0412c86dce5c2ac21490b 2023-07-14 08:13:00,166 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf/2f02f653044f48ebbc0eb0eeba824b36 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/cf/2f02f653044f48ebbc0eb0eeba824b36 2023-07-14 08:13:00,172 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2/recovered.edits/9.seqid 2023-07-14 08:13:00,172 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008/recovered.edits/9.seqid 2023-07-14 08:13:00,173 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/4412465e6a0d82836c22d59edee2e0c2 2023-07-14 08:13:00,173 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportWithTargetName/fc5bd246c38ce5165bd7cf028fdbb008 2023-07-14 08:13:00,173 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 08:13:00,173 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 08:13:00,174 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-14 08:13:00,179 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071472dc63ade36b45be94fd611b79a1da3f to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023071472dc63ade36b45be94fd611b79a1da3f 2023-07-14 08:13:00,180 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714b77a0cac4076478dab00064a67636451 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230714b77a0cac4076478dab00064a67636451 2023-07-14 08:13:00,181 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-14 08:13:00,184 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:13:00,213 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 08:13:00,216 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 08:13:00,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:13:00,218 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 08:13:00,218 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322380218"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:00,218 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322380218"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:00,221 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:13:00,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fc5bd246c38ce5165bd7cf028fdbb008, NAME => 'testtb-testExportWithTargetName,,1689322354917.fc5bd246c38ce5165bd7cf028fdbb008.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4412465e6a0d82836c22d59edee2e0c2, NAME => 'testtb-testExportWithTargetName,1,1689322354917.4412465e6a0d82836c22d59edee2e0c2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:13:00,221 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 08:13:00,221 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322380221"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:00,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 08:13:00,227 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 08:13:00,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 93 msec 2023-07-14 08:13:00,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 08:13:00,262 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 08:13:00,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 08:13:00,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 08:13:00,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 08:13:00,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 08:13:00,335 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 702) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:60808 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1318 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1154669656) connection to jenkins-hbase9.apache.org/172.31.2.10:33489 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1154669656) connection to jenkins-hbase9.apache.org/172.31.2.10:46671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:55964 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1010717853_1 at /127.0.0.1:36626 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1793469469_17 at /127.0.0.1:36650 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1154669656) connection to jenkins-hbase9.apache.org/172.31.2.10:41827 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=683 (was 647) - SystemLoadAverage LEAK? -, ProcessCount=189 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=917 (was 2650) 2023-07-14 08:13:00,336 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 08:13:00,360 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=683, ProcessCount=189, AvailableMemoryMB=916 2023-07-14 08:13:00,360 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-14 08:13:00,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 08:13:00,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:00,371 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:13:00,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 08:13:00,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:13:00,373 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:13:00,377 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,377 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,378 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a empty. 2023-07-14 08:13:00,379 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd empty. 2023-07-14 08:13:00,380 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,380 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,380 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 08:13:00,408 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 08:13:00,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5551c58efee35b1d9ae96ba67aba546a, NAME => 'testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:13:00,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a1044cb8c4c34f80208694dbb57e31bd, NAME => 'testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:13:00,458 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:00,460 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 5551c58efee35b1d9ae96ba67aba546a, disabling compactions & flushes 2023-07-14 08:13:00,460 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,460 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,460 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. after waiting 0 ms 2023-07-14 08:13:00,460 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,460 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,461 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 5551c58efee35b1d9ae96ba67aba546a: 2023-07-14 08:13:00,469 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:00,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a1044cb8c4c34f80208694dbb57e31bd, disabling compactions & flushes 2023-07-14 08:13:00,471 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. after waiting 0 ms 2023-07-14 08:13:00,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,471 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,471 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a1044cb8c4c34f80208694dbb57e31bd: 2023-07-14 08:13:00,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:13:00,476 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:13:00,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322380477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322380477"}]},"ts":"1689322380477"} 2023-07-14 08:13:00,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322380477"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322380477"}]},"ts":"1689322380477"} 2023-07-14 08:13:00,480 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:13:00,481 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:13:00,482 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322380482"}]},"ts":"1689322380482"} 2023-07-14 08:13:00,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 08:13:00,488 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:13:00,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:13:00,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:13:00,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:13:00,489 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:13:00,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, ASSIGN}] 2023-07-14 08:13:00,493 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, ASSIGN 2023-07-14 08:13:00,493 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, ASSIGN 2023-07-14 08:13:00,495 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44291,1689322343258; forceNewPlan=false, retain=false 2023-07-14 08:13:00,495 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38267,1689322343329; forceNewPlan=false, retain=false 2023-07-14 08:13:00,646 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:13:00,649 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5551c58efee35b1d9ae96ba67aba546a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:00,649 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a1044cb8c4c34f80208694dbb57e31bd, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:00,650 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322380649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322380649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322380649"}]},"ts":"1689322380649"} 2023-07-14 08:13:00,650 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322380649"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322380649"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322380649"}]},"ts":"1689322380649"} 2023-07-14 08:13:00,652 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 5551c58efee35b1d9ae96ba67aba546a, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:13:00,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure a1044cb8c4c34f80208694dbb57e31bd, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:13:00,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:13:00,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5551c58efee35b1d9ae96ba67aba546a, NAME => 'testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:13:00,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. service=AccessControlService 2023-07-14 08:13:00,812 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:13:00,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:00,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,818 INFO [StoreOpener-5551c58efee35b1d9ae96ba67aba546a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,822 DEBUG [StoreOpener-5551c58efee35b1d9ae96ba67aba546a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf 2023-07-14 08:13:00,822 DEBUG [StoreOpener-5551c58efee35b1d9ae96ba67aba546a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf 2023-07-14 08:13:00,822 INFO [StoreOpener-5551c58efee35b1d9ae96ba67aba546a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5551c58efee35b1d9ae96ba67aba546a columnFamilyName cf 2023-07-14 08:13:00,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1044cb8c4c34f80208694dbb57e31bd, NAME => 'testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:13:00,824 INFO [StoreOpener-5551c58efee35b1d9ae96ba67aba546a-1] regionserver.HStore(310): Store=5551c58efee35b1d9ae96ba67aba546a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:13:00,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. service=AccessControlService 2023-07-14 08:13:00,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:13:00,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:00,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,828 INFO [StoreOpener-a1044cb8c4c34f80208694dbb57e31bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,830 DEBUG [StoreOpener-a1044cb8c4c34f80208694dbb57e31bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf 2023-07-14 08:13:00,830 DEBUG [StoreOpener-a1044cb8c4c34f80208694dbb57e31bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf 2023-07-14 08:13:00,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:00,831 INFO [StoreOpener-a1044cb8c4c34f80208694dbb57e31bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1044cb8c4c34f80208694dbb57e31bd columnFamilyName cf 2023-07-14 08:13:00,832 INFO [StoreOpener-a1044cb8c4c34f80208694dbb57e31bd-1] regionserver.HStore(310): Store=a1044cb8c4c34f80208694dbb57e31bd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:13:00,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:13:00,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5551c58efee35b1d9ae96ba67aba546a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62675247, jitterRate=-0.06606604158878326}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:13:00,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5551c58efee35b1d9ae96ba67aba546a: 2023-07-14 08:13:00,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a., pid=30, masterSystemTime=1689322380807 2023-07-14 08:13:00,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:00,839 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=5551c58efee35b1d9ae96ba67aba546a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:00,839 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322380839"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322380839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322380839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322380839"}]},"ts":"1689322380839"} 2023-07-14 08:13:00,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:13:00,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened a1044cb8c4c34f80208694dbb57e31bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70329814, jitterRate=0.04799589514732361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:13:00,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for a1044cb8c4c34f80208694dbb57e31bd: 2023-07-14 08:13:00,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd., pid=31, masterSystemTime=1689322380811 2023-07-14 08:13:00,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-14 08:13:00,847 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 5551c58efee35b1d9ae96ba67aba546a, server=jenkins-hbase9.apache.org,44291,1689322343258 in 190 msec 2023-07-14 08:13:00,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,851 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:00,852 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, ASSIGN in 357 msec 2023-07-14 08:13:00,852 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a1044cb8c4c34f80208694dbb57e31bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:00,853 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322380852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322380852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322380852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322380852"}]},"ts":"1689322380852"} 2023-07-14 08:13:00,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-14 08:13:00,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure a1044cb8c4c34f80208694dbb57e31bd, server=jenkins-hbase9.apache.org,38267,1689322343329 in 197 msec 2023-07-14 08:13:00,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-14 08:13:00,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, ASSIGN in 368 msec 2023-07-14 08:13:00,863 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:13:00,864 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322380864"}]},"ts":"1689322380864"} 2023-07-14 08:13:00,866 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 08:13:00,869 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:13:00,869 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 08:13:00,872 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:13:00,874 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,875 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,876 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,877 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:00,877 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:00,877 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:00,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:00,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:00,878 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:00,879 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:00,881 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 514 msec 2023-07-14 08:13:00,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 08:13:00,978 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 08:13:00,982 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 08:13:00,982 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:00,985 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:01,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:13:01,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322381009 (current time:1689322381009). 2023-07-14 08:13:01,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:13:01,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x414816cc to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:01,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68d3e13f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:01,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:01,027 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:01,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x414816cc to 127.0.0.1:53917 2023-07-14 08:13:01,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:01,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x753fa44e to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:01,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74403253, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:01,047 DEBUG [hconnection-0x36dfffd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:01,053 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:01,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x753fa44e to 127.0.0.1:53917 2023-07-14 08:13:01,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:01,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:13:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:13:01,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:13:01,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:13:01,067 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:13:01,068 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689322981068 2023-07-14 08:13:01,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:13:01,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 08:13:01,069 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:13:01,070 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:13:01,070 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:13:01,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:13:01,073 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-14 08:13:01,074 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:13:01,076 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689322981076 2023-07-14 08:13:01,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,122 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 08:13:01,122 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,123 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 08:13:01,123 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:13:01,123 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,124 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,125 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,125 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,125 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,125 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,126 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,127 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,127 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,127 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 08:13:01,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,127 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:13:01,127 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,128 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:13:01,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,128 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:13:01,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 08:13:01,128 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 08:13:01,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,130 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:13:01,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:13:01,130 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:13:01,130 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:13:01,130 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 08:13:01,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,131 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:13:01,131 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,131 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:13:01,132 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:13:01,133 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,133 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:13:01,134 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 08:13:01,134 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:13:01,134 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:13:01,134 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 08:13:01,135 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,135 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,140 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,140 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,140 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,140 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,140 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:01,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,141 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,141 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,141 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:01,141 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:01,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9a91e8[Count = 1] remaining members to acquire global barrier 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:13:01,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9a91e8[Count = 0] remaining members to acquire global barrier 2023-07-14 08:13:01,146 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:13:01,146 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,147 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:13:01,148 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 08:13:01,148 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:01,149 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. started... 2023-07-14 08:13:01,148 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:13:01,148 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,149 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:13:01,149 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5551c58efee35b1d9ae96ba67aba546a: 2023-07-14 08:13:01,149 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:01,149 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,149 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:01,149 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:13:01,149 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:01,150 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. started... 2023-07-14 08:13:01,151 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1044cb8c4c34f80208694dbb57e31bd: 2023-07-14 08:13:01,151 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:13:01,151 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:01,151 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 08:13:01,151 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,151 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:01,152 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:13:01,170 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:01,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:13:01,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:01,172 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:13:01,184 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. completed. 2023-07-14 08:13:01,184 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:01,184 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. completed. 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,184 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:13:01,184 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 08:13:01,185 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:13:01,186 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:13:01,186 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:01,186 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 08:13:01,186 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,188 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:13:01,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,188 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,188 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:01,188 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 08:13:01,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:13:01,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:13:01,199 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 08:13:01,199 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:13:01,199 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:13:01,199 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,199 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:01,203 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:01,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:01,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:01,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,208 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,208 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,210 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,212 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,212 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,213 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,216 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,216 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,216 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 08:13:01,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,217 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:01,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:01,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,219 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,219 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,217 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,219 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:01,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:01,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:13:01,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:01,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,219 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:01,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:01,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:01,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:01,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:01,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 08:13:01,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState because node does not exist (not an error) 2023-07-14 08:13:01,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,305 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,372 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:01,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:13:01,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:01,374 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:13:01,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 08:13:01,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,399 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:01,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689322381069Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689322381266 (+197 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689322381266Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689322381266Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689322381272 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689322381295 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689322381399 (+104 ms) 2023-07-14 08:13:01,402 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:13:01,411 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 332 msec 2023-07-14 08:13:01,674 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:01,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:13:01,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:13:01,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44291] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:13:01,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38267] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:13:01,696 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 08:13:01,697 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:01,697 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:01,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:13:01,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322381721 (current time:1689322381721). 2023-07-14 08:13:01,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:13:01,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x135ce477 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:01,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@17b8881a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:01,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:01,751 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:01,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x135ce477 to 127.0.0.1:53917 2023-07-14 08:13:01,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:01,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x599cd7c1 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:01,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ebc5a29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:01,768 DEBUG [hconnection-0x4214a722-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:01,769 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:44592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:01,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x599cd7c1 to 127.0.0.1:53917 2023-07-14 08:13:01,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:01,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:13:01,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:13:01,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:13:01,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:13:01,782 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:13:01,788 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689322981788 2023-07-14 08:13:01,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:13:01,788 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 08:13:01,790 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:13:01,790 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:13:01,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:13:01,792 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:13:01,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-14 08:13:01,795 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:13:01,795 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689322981795 2023-07-14 08:13:01,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 08:13:01,823 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 08:13:01,823 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,824 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 08:13:01,825 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:13:01,881 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,881 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,883 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,883 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,883 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:01,883 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:01,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:01,883 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,883 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,884 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 08:13:01,885 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 08:13:01,885 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 08:13:01,885 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:13:01,885 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,885 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,885 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 08:13:01,888 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:13:01,888 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:13:01,887 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:13:01,888 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:13:01,888 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 08:13:01,888 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:01,888 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 08:13:01,890 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 08:13:01,890 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 08:13:01,890 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 08:13:01,890 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:01,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:13:01,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:01,891 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,892 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:13:01,894 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,894 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,894 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,894 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:01,895 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,896 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,896 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:01,896 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,896 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:01,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fb522c5[Count = 1] remaining members to acquire global barrier 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:01,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:01,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:01,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 08:13:01,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fb522c5[Count = 0] remaining members to acquire global barrier 2023-07-14 08:13:01,902 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:13:01,902 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:13:01,904 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:01,904 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:01,904 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:01,904 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. started... 2023-07-14 08:13:01,904 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:01,904 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:13:01,904 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5551c58efee35b1d9ae96ba67aba546a 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 08:13:01,906 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:13:01,906 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:01,906 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 08:13:01,912 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:01,913 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:01,913 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:01,914 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. started... 2023-07-14 08:13:01,914 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1044cb8c4c34f80208694dbb57e31bd 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 08:13:01,968 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307145bd88922a11c4b93a56fc42247f69cbd to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307145bd88922a11c4b93a56fc42247f69cbd 2023-07-14 08:13:01,992 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071470e3580d3f824ba6a484e783f01790e7 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071470e3580d3f824ba6a484e783f01790e7 2023-07-14 08:13:01,999 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/.tmp/cf/9a25a7473ffd417a9daca4ffe5faccec 2023-07-14 08:13:02,010 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/.tmp/cf/9a25a7473ffd417a9daca4ffe5faccec as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf/9a25a7473ffd417a9daca4ffe5faccec 2023-07-14 08:13:02,017 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/.tmp/cf/695c1105a2bb4ce388c011cf7c2aab80 2023-07-14 08:13:02,020 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf/9a25a7473ffd417a9daca4ffe5faccec, entries=45, sequenceid=6, filesize=12.5 K 2023-07-14 08:13:02,023 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for a1044cb8c4c34f80208694dbb57e31bd in 109ms, sequenceid=6, compaction requested=false 2023-07-14 08:13:02,023 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 08:13:02,024 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1044cb8c4c34f80208694dbb57e31bd: 2023-07-14 08:13:02,025 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:13:02,025 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:02,025 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf/9a25a7473ffd417a9daca4ffe5faccec] hfiles 2023-07-14 08:13:02,025 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf/9a25a7473ffd417a9daca4ffe5faccec for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:13:02,031 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/.tmp/cf/695c1105a2bb4ce388c011cf7c2aab80 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf/695c1105a2bb4ce388c011cf7c2aab80 2023-07-14 08:13:02,038 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf/695c1105a2bb4ce388c011cf7c2aab80, entries=5, sequenceid=6, filesize=5.7 K 2023-07-14 08:13:02,039 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5551c58efee35b1d9ae96ba67aba546a in 135ms, sequenceid=6, compaction requested=false 2023-07-14 08:13:02,042 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5551c58efee35b1d9ae96ba67aba546a: 2023-07-14 08:13:02,042 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:13:02,042 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:02,043 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf/695c1105a2bb4ce388c011cf7c2aab80] hfiles 2023-07-14 08:13:02,043 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf/695c1105a2bb4ce388c011cf7c2aab80 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:13:02,049 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. completed. 2023-07-14 08:13:02,051 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:02,051 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:02,051 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:02,051 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,051 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 08:13:02,051 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:13:02,056 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:13:02,056 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:02,056 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,056 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 08:13:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:02,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:02,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:02,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:13:02,060 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:13:02,066 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. completed. 2023-07-14 08:13:02,066 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:02,066 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:02,066 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:02,066 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,066 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 08:13:02,066 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:13:02,068 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,068 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 08:13:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:02,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:02,068 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:02,068 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 08:13:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:02,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:02,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:13:02,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:13:02,074 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 08:13:02,074 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:13:02,074 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:13:02,074 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 08:13:02,074 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:02,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:02,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:02,077 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:02,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:02,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,078 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:02,080 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:02,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,083 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,083 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:02,083 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 08:13:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,089 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,089 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,089 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,092 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:02,093 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:02,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 08:13:02,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:02,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:02,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:13:02,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:02,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:02,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:02,095 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:13:02,093 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:02,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:02,093 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-14 08:13:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:02,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 08:13:02,096 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:02,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:13:02,096 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,096 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:02,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:02,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:02,096 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:02,096 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,096 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307145bd88922a11c4b93a56fc42247f69cbd, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071470e3580d3f824ba6a484e783f01790e7] mob files 2023-07-14 08:13:02,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307145bd88922a11c4b93a56fc42247f69cbd 2023-07-14 08:13:02,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071470e3580d3f824ba6a484e783f01790e7 2023-07-14 08:13:02,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 08:13:02,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,142 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,174 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 08:13:02,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,174 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689322381788Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689322382115 (+327 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689322382115Loading Region manifests for snaptb0-testExportFileSystemState at 1689322382115Writing data manifest for snaptb0-testExportFileSystemState at 1689322382122 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689322382134 (+12 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689322382174 (+40 ms) 2023-07-14 08:13:02,177 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 08:13:02,180 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 388 msec 2023-07-14 08:13:02,396 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:02,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:13:02,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:13:02,399 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399 2023-07-14 08:13:02,399 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43813, tgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399, rawTgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:13:02,444 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:13:02,444 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1092038307_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,444 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 08:13:02,471 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 08:13:02,546 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:02,547 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:02,547 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:02,548 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,628 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-5687383830289057576.jar 2023-07-14 08:13:03,629 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,630 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,710 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-2863385513499543556.jar 2023-07-14 08:13:03,711 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,711 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,712 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,712 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,712 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,713 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:03,713 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:13:03,714 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:13:03,714 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:13:03,715 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:13:03,715 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:13:03,716 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:13:03,716 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:13:03,717 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:13:03,717 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:13:03,717 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:13:03,718 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:03,719 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:03,719 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:03,720 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:03,720 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:03,721 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:03,721 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:04,247 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0001_000001 (auth:SIMPLE) 2023-07-14 08:13:05,113 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:13:05,117 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 08:13:05,120 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-14 08:13:05,344 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:05,344 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:05,665 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:13:06,049 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:11,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:13,835 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:19,519 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:13:19,522 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:13:19,537 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 08:13:19,537 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:13:19,538 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:13:19,538 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 08:13:19,547 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 08:13:19,547 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 08:13:19,547 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 08:13:19,548 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 08:13:19,548 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322382399/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 08:13:19,559 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 08:13:19,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 08:13:19,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,568 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322399568"}]},"ts":"1689322399568"} 2023-07-14 08:13:19,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 08:13:19,570 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 08:13:19,573 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 08:13:19,574 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, UNASSIGN}] 2023-07-14 08:13:19,576 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, UNASSIGN 2023-07-14 08:13:19,578 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, UNASSIGN 2023-07-14 08:13:19,579 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a1044cb8c4c34f80208694dbb57e31bd, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:19,580 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322399579"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322399579"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322399579"}]},"ts":"1689322399579"} 2023-07-14 08:13:19,581 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5551c58efee35b1d9ae96ba67aba546a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:19,581 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322399580"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322399580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322399580"}]},"ts":"1689322399580"} 2023-07-14 08:13:19,583 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure a1044cb8c4c34f80208694dbb57e31bd, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:13:19,584 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 5551c58efee35b1d9ae96ba67aba546a, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:13:19,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 08:13:19,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:19,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing a1044cb8c4c34f80208694dbb57e31bd, disabling compactions & flushes 2023-07-14 08:13:19,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:19,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5551c58efee35b1d9ae96ba67aba546a, disabling compactions & flushes 2023-07-14 08:13:19,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:19,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:19,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. after waiting 0 ms 2023-07-14 08:13:19,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:19,738 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:19,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:19,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. after waiting 0 ms 2023-07-14 08:13:19,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:19,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:13:19,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:13:19,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:13:19,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:13:19,777 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd. 2023-07-14 08:13:19,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a. 2023-07-14 08:13:19,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5551c58efee35b1d9ae96ba67aba546a: 2023-07-14 08:13:19,778 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for a1044cb8c4c34f80208694dbb57e31bd: 2023-07-14 08:13:19,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:19,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:19,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=5551c58efee35b1d9ae96ba67aba546a, regionState=CLOSED 2023-07-14 08:13:19,786 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a1044cb8c4c34f80208694dbb57e31bd, regionState=CLOSED 2023-07-14 08:13:19,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322399786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322399786"}]},"ts":"1689322399786"} 2023-07-14 08:13:19,786 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689322399786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322399786"}]},"ts":"1689322399786"} 2023-07-14 08:13:19,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-14 08:13:19,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 5551c58efee35b1d9ae96ba67aba546a, server=jenkins-hbase9.apache.org,44291,1689322343258 in 205 msec 2023-07-14 08:13:19,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-14 08:13:19,795 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure a1044cb8c4c34f80208694dbb57e31bd, server=jenkins-hbase9.apache.org,38267,1689322343329 in 208 msec 2023-07-14 08:13:19,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=5551c58efee35b1d9ae96ba67aba546a, UNASSIGN in 219 msec 2023-07-14 08:13:19,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 08:13:19,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a1044cb8c4c34f80208694dbb57e31bd, UNASSIGN in 221 msec 2023-07-14 08:13:19,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322399799"}]},"ts":"1689322399799"} 2023-07-14 08:13:19,803 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 08:13:19,805 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 08:13:19,807 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 244 msec 2023-07-14 08:13:19,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 08:13:19,872 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 08:13:19,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 08:13:19,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,879 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 08:13:19,880 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,882 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 08:13:19,887 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,887 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,887 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,887 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:19,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:19,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:19,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:19,890 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:19,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 08:13:19,894 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:19,894 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:19,896 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/recovered.edits] 2023-07-14 08:13:19,897 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/recovered.edits] 2023-07-14 08:13:19,904 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf/9a25a7473ffd417a9daca4ffe5faccec to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/cf/9a25a7473ffd417a9daca4ffe5faccec 2023-07-14 08:13:19,904 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf/695c1105a2bb4ce388c011cf7c2aab80 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/cf/695c1105a2bb4ce388c011cf7c2aab80 2023-07-14 08:13:19,910 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a/recovered.edits/9.seqid 2023-07-14 08:13:19,910 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/5551c58efee35b1d9ae96ba67aba546a 2023-07-14 08:13:19,916 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd/recovered.edits/9.seqid 2023-07-14 08:13:19,920 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemState/a1044cb8c4c34f80208694dbb57e31bd 2023-07-14 08:13:19,920 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 08:13:19,921 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 08:13:19,922 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-14 08:13:19,926 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307145bd88922a11c4b93a56fc42247f69cbd to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307145bd88922a11c4b93a56fc42247f69cbd 2023-07-14 08:13:19,928 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071470e3580d3f824ba6a484e783f01790e7 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023071470e3580d3f824ba6a484e783f01790e7 2023-07-14 08:13:19,929 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-14 08:13:19,933 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,937 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 08:13:19,943 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 08:13:19,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,954 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 08:13:19,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322399954"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:19,954 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322399954"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:19,957 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:13:19,957 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5551c58efee35b1d9ae96ba67aba546a, NAME => 'testtb-testExportFileSystemState,,1689322380362.5551c58efee35b1d9ae96ba67aba546a.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a1044cb8c4c34f80208694dbb57e31bd, NAME => 'testtb-testExportFileSystemState,1,1689322380362.a1044cb8c4c34f80208694dbb57e31bd.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:13:19,958 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 08:13:19,958 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322399958"}]},"ts":"9223372036854775807"} 2023-07-14 08:13:19,960 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 08:13:19,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 08:13:19,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 89 msec 2023-07-14 08:13:19,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 08:13:19,995 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 08:13:20,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 08:13:20,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 08:13:20,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 08:13:20,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 08:13:20,058 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753 (was 751) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943067718_1 at /127.0.0.1:39742 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1943067718_1 at /127.0.0.1:60216 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:48926 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:39764 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:60246 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2145 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1154669656) connection to jenkins-hbase9.apache.org/172.31.2.10:39237 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=585 (was 683), ProcessCount=189 (was 189), AvailableMemoryMB=799 (was 916) 2023-07-14 08:13:20,058 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-14 08:13:20,091 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=753, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=585, ProcessCount=189, AvailableMemoryMB=799 2023-07-14 08:13:20,091 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-14 08:13:20,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 08:13:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:13:20,106 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:13:20,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 08:13:20,109 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:13:20,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:20,112 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,112 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,113 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb empty. 2023-07-14 08:13:20,113 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 empty. 2023-07-14 08:13:20,115 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,115 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,115 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 08:13:20,163 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 08:13:20,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => f90cb6217875d549c8eab0031b3b5eeb, NAME => 'testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:13:20,165 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => f10086fe52370c4d6b376fdfe734fed5, NAME => 'testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:13:20,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:20,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing f10086fe52370c4d6b376fdfe734fed5, disabling compactions & flushes 2023-07-14 08:13:20,193 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. after waiting 0 ms 2023-07-14 08:13:20,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,193 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,193 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for f10086fe52370c4d6b376fdfe734fed5: 2023-07-14 08:13:20,196 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:20,202 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing f90cb6217875d549c8eab0031b3b5eeb, disabling compactions & flushes 2023-07-14 08:13:20,202 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,202 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,202 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. after waiting 0 ms 2023-07-14 08:13:20,202 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,202 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,202 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for f90cb6217875d549c8eab0031b3b5eeb: 2023-07-14 08:13:20,206 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:13:20,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322400207"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322400207"}]},"ts":"1689322400207"} 2023-07-14 08:13:20,207 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322400207"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322400207"}]},"ts":"1689322400207"} 2023-07-14 08:13:20,210 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:13:20,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:20,211 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:13:20,212 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322400211"}]},"ts":"1689322400211"} 2023-07-14 08:13:20,213 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 08:13:20,217 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:13:20,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:13:20,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:13:20,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:13:20,218 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:13:20,219 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, ASSIGN}] 2023-07-14 08:13:20,222 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, ASSIGN 2023-07-14 08:13:20,222 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, ASSIGN 2023-07-14 08:13:20,224 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44291,1689322343258; forceNewPlan=false, retain=false 2023-07-14 08:13:20,225 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38267,1689322343329; forceNewPlan=false, retain=false 2023-07-14 08:13:20,374 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:13:20,377 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f90cb6217875d549c8eab0031b3b5eeb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,377 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f10086fe52370c4d6b376fdfe734fed5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,377 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322400377"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322400377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322400377"}]},"ts":"1689322400377"} 2023-07-14 08:13:20,377 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322400377"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322400377"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322400377"}]},"ts":"1689322400377"} 2023-07-14 08:13:20,380 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure f90cb6217875d549c8eab0031b3b5eeb, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:13:20,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure f10086fe52370c4d6b376fdfe734fed5, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:13:20,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:20,536 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f90cb6217875d549c8eab0031b3b5eeb, NAME => 'testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:13:20,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. service=AccessControlService 2023-07-14 08:13:20,537 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:13:20,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:20,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,538 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f10086fe52370c4d6b376fdfe734fed5, NAME => 'testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:13:20,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. service=AccessControlService 2023-07-14 08:13:20,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:13:20,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:13:20,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,539 INFO [StoreOpener-f90cb6217875d549c8eab0031b3b5eeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,540 INFO [StoreOpener-f10086fe52370c4d6b376fdfe734fed5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,541 DEBUG [StoreOpener-f90cb6217875d549c8eab0031b3b5eeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf 2023-07-14 08:13:20,541 DEBUG [StoreOpener-f90cb6217875d549c8eab0031b3b5eeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf 2023-07-14 08:13:20,542 INFO [StoreOpener-f90cb6217875d549c8eab0031b3b5eeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f90cb6217875d549c8eab0031b3b5eeb columnFamilyName cf 2023-07-14 08:13:20,543 INFO [StoreOpener-f90cb6217875d549c8eab0031b3b5eeb-1] regionserver.HStore(310): Store=f90cb6217875d549c8eab0031b3b5eeb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:13:20,544 DEBUG [StoreOpener-f10086fe52370c4d6b376fdfe734fed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf 2023-07-14 08:13:20,546 DEBUG [StoreOpener-f10086fe52370c4d6b376fdfe734fed5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf 2023-07-14 08:13:20,546 INFO [StoreOpener-f10086fe52370c4d6b376fdfe734fed5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f10086fe52370c4d6b376fdfe734fed5 columnFamilyName cf 2023-07-14 08:13:20,546 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,547 INFO [StoreOpener-f10086fe52370c4d6b376fdfe734fed5-1] regionserver.HStore(310): Store=f10086fe52370c4d6b376fdfe734fed5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:13:20,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:13:20,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:13:20,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:13:20,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f90cb6217875d549c8eab0031b3b5eeb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72611893, jitterRate=0.08200152218341827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:13:20,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f90cb6217875d549c8eab0031b3b5eeb: 2023-07-14 08:13:20,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb., pid=45, masterSystemTime=1689322400532 2023-07-14 08:13:20,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:13:20,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened f10086fe52370c4d6b376fdfe734fed5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69036405, jitterRate=0.028722599148750305}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:13:20,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for f10086fe52370c4d6b376fdfe734fed5: 2023-07-14 08:13:20,556 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5., pid=46, masterSystemTime=1689322400535 2023-07-14 08:13:20,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,558 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=f90cb6217875d549c8eab0031b3b5eeb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322400558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322400558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322400558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322400558"}]},"ts":"1689322400558"} 2023-07-14 08:13:20,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,560 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=f10086fe52370c4d6b376fdfe734fed5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,561 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322400559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322400559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322400559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322400559"}]},"ts":"1689322400559"} 2023-07-14 08:13:20,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-14 08:13:20,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure f90cb6217875d549c8eab0031b3b5eeb, server=jenkins-hbase9.apache.org,38267,1689322343329 in 185 msec 2023-07-14 08:13:20,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-14 08:13:20,569 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure f10086fe52370c4d6b376fdfe734fed5, server=jenkins-hbase9.apache.org,44291,1689322343258 in 185 msec 2023-07-14 08:13:20,570 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, ASSIGN in 349 msec 2023-07-14 08:13:20,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-14 08:13:20,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, ASSIGN in 352 msec 2023-07-14 08:13:20,573 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:13:20,573 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322400573"}]},"ts":"1689322400573"} 2023-07-14 08:13:20,575 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 08:13:20,578 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:13:20,578 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 08:13:20,580 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 08:13:20,583 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:20,583 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:20,583 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:20,583 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:13:20,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:20,584 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:20,585 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:20,586 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 08:13:20,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 488 msec 2023-07-14 08:13:20,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 08:13:20,714 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 08:13:20,717 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 08:13:20,717 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,719 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:20,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322400742 (current time:1689322400742). 2023-07-14 08:13:20,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:13:20,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x527a7627 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:20,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3de7672c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:20,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:20,764 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:20,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x527a7627 to 127.0.0.1:53917 2023-07-14 08:13:20,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:20,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x75635396 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:20,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7429d853, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:20,778 DEBUG [hconnection-0x72711ffd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:20,782 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:20,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75635396 to 127.0.0.1:53917 2023-07-14 08:13:20,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:20,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 08:13:20,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:13:20,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:20,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:20,795 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:20,796 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689323000796 2023-07-14 08:13:20,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 08:13:20,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:20,797 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:13:20,797 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:13:20,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:20,799 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:20,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-14 08:13:20,801 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:20,808 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689323000808 2023-07-14 08:13:20,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,830 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 08:13:20,830 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:20,831 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 08:13:20,831 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 08:13:20,831 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,831 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,833 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,833 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,833 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,833 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,834 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,834 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,834 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,834 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 08:13:20,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:20,835 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:20,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,837 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,838 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,838 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:20,838 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:20,838 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:20,838 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:20,839 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:20,839 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:20,839 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:20,838 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:20,840 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:20,844 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:20,844 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:20,844 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:20,839 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:20,844 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:20,844 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:20,852 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,852 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,855 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:20,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,855 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:20,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@471c2a84[Count = 1] remaining members to acquire global barrier 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:20,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@471c2a84[Count = 0] remaining members to acquire global barrier 2023-07-14 08:13:20,861 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 08:13:20,861 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,863 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,863 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,863 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:20,864 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:20,864 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:20,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,864 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,864 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:20,864 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. started... 2023-07-14 08:13:20,864 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:20,864 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,865 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:13:20,864 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:20,865 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f10086fe52370c4d6b376fdfe734fed5: 2023-07-14 08:13:20,865 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:13:20,865 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,865 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,865 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. started... 2023-07-14 08:13:20,865 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:20,867 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:20,867 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:20,868 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f90cb6217875d549c8eab0031b3b5eeb: 2023-07-14 08:13:20,869 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,869 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:20,869 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:13:20,868 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:13:20,878 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:20,878 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,878 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:20,898 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:20,910 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. completed. 2023-07-14 08:13:20,910 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:20,910 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:20,910 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:20,910 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:20,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:20,911 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:20,911 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:13:20,912 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:13:20,915 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,915 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:20,915 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,915 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,924 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. completed. 2023-07-14 08:13:20,924 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:20,924 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:20,924 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:20,924 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,924 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:20,924 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:13:20,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,926 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,926 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:20,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,926 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,926 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:13:20,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 08:13:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:13:20,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 08:13:20,937 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 08:13:20,937 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:13:20,937 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:13:20,937 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,937 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:20,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,940 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,943 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,944 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:20,945 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,948 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:20,949 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,949 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,954 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:20,954 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,957 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 08:13:20,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:20,955 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:20,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:13:20,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:20,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:20,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 08:13:20,975 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:20,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:21,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:21,099 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 08:13:21,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:21,102 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 08:13:21,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689322400796Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689322400975 (+179 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689322400975Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689322400975Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689322400988 (+13 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689322401016 (+28 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689322401099 (+83 ms) 2023-07-14 08:13:21,106 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:21,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 309 msec 2023-07-14 08:13:21,112 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:21,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:21,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:13:21,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44291] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:13:21,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38267] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:13:21,125 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 08:13:21,125 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:21,125 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:13:21,156 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:21,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322401156 (current time:1689322401156). 2023-07-14 08:13:21,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:13:21,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x3e12b102 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:21,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@210a0bc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:21,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:21,180 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:21,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e12b102 to 127.0.0.1:53917 2023-07-14 08:13:21,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:21,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x78dba978 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:13:21,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53ea9dc0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:13:21,226 DEBUG [hconnection-0x22cf983e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:13:21,230 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:56044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:13:21,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78dba978 to 127.0.0.1:53917 2023-07-14 08:13:21,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:13:21,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 08:13:21,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:13:21,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:21,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:21,242 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:21,244 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689323001244 2023-07-14 08:13:21,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 08:13:21,244 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 08:13:21,245 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:13:21,245 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:13:21,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:21,247 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 08:13:21,249 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-14 08:13:21,250 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:21,251 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689323001251 2023-07-14 08:13:21,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 08:13:21,293 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 08:13:21,294 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:21,295 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 08:13:21,295 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 08:13:21,295 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,295 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,297 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:21,297 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:21,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:21,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:21,297 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,297 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:21,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:21,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:21,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:21,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:21,298 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,298 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,299 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,299 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:21,299 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:21,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 08:13:21,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,300 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 08:13:21,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 08:13:21,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 08:13:21,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 08:13:21,310 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:21,310 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:21,310 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 08:13:21,310 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:21,310 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:21,310 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:13:21,314 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:21,312 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 08:13:21,315 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 08:13:21,317 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,318 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:21,318 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,318 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,318 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:21,318 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,319 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:21,319 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,319 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:21,319 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,319 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:13:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34b5c56c[Count = 1] remaining members to acquire global barrier 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:21,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:21,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 08:13:21,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34b5c56c[Count = 0] remaining members to acquire global barrier 2023-07-14 08:13:21,324 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 08:13:21,324 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:21,325 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,326 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:21,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,326 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:21,326 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,326 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:13:21,326 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:21,326 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:21,326 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 08:13:21,326 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. started... 2023-07-14 08:13:21,326 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:21,326 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:13:21,326 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f90cb6217875d549c8eab0031b3b5eeb 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-14 08:13:21,332 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:21,332 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:21,332 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:21,335 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:13:21,335 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:13:21,336 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:21,336 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. started... 2023-07-14 08:13:21,336 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f10086fe52370c4d6b376fdfe734fed5 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-14 08:13:21,346 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:21,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:21,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:21,349 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:13:21,403 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714c73424f31a94411e81a98498a3528eb4 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714c73424f31a94411e81a98498a3528eb4 2023-07-14 08:13:21,414 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307144889f373e51746d4bc2ec9c4acf0f116 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307144889f373e51746d4bc2ec9c4acf0f116 2023-07-14 08:13:21,449 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/.tmp/cf/57319ff0e5104b939d30ea48ff141ebb 2023-07-14 08:13:21,458 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/.tmp/cf/57319ff0e5104b939d30ea48ff141ebb as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf/57319ff0e5104b939d30ea48ff141ebb 2023-07-14 08:13:21,460 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/.tmp/cf/ac5265471678465ebce8fbdc2f0a6f4b 2023-07-14 08:13:21,469 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/.tmp/cf/ac5265471678465ebce8fbdc2f0a6f4b as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf/ac5265471678465ebce8fbdc2f0a6f4b 2023-07-14 08:13:21,469 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf/57319ff0e5104b939d30ea48ff141ebb, entries=6, sequenceid=6, filesize=5.9 K 2023-07-14 08:13:21,482 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for f10086fe52370c4d6b376fdfe734fed5 in 146ms, sequenceid=6, compaction requested=false 2023-07-14 08:13:21,482 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 08:13:21,483 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f10086fe52370c4d6b376fdfe734fed5: 2023-07-14 08:13:21,483 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:21,483 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:21,483 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf/57319ff0e5104b939d30ea48ff141ebb] hfiles 2023-07-14 08:13:21,483 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf/57319ff0e5104b939d30ea48ff141ebb for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:21,489 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf/ac5265471678465ebce8fbdc2f0a6f4b, entries=44, sequenceid=6, filesize=12.2 K 2023-07-14 08:13:21,500 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for f90cb6217875d549c8eab0031b3b5eeb in 174ms, sequenceid=6, compaction requested=false 2023-07-14 08:13:21,501 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f90cb6217875d549c8eab0031b3b5eeb: 2023-07-14 08:13:21,502 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:21,502 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:13:21,502 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf/ac5265471678465ebce8fbdc2f0a6f4b] hfiles 2023-07-14 08:13:21,502 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf/ac5265471678465ebce8fbdc2f0a6f4b for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:21,517 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. completed. 2023-07-14 08:13:21,518 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:13:21,518 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:21,518 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:21,518 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,518 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:21,518 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:13:21,520 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,520 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:21,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:21,520 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:21,520 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:21,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:21,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:21,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:21,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:13:21,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 08:13:21,542 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. completed. 2023-07-14 08:13:21,542 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:13:21,543 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:13:21,543 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:13:21,543 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,543 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 08:13:21,543 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:13:21,545 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,545 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 08:13:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:21,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:21,545 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:21,545 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 08:13:21,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,549 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:21,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:21,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:13:21,551 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:13:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:13:21,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 08:13:21,552 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 08:13:21,552 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:13:21,552 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:13:21,552 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 08:13:21,552 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:13:21,554 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,554 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,555 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,554 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,554 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,554 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:21,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:21,554 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:21,556 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:21,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:21,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:13:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:13:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,556 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:13:21,558 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:13:21,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,560 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,560 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:13:21,561 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 08:13:21,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,570 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:21,570 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:21,570 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:21,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:21,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:21,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:21,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:21,572 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:13:21,572 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:21,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:13:21,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:13:21,572 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:13:21,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 08:13:21,572 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-14 08:13:21,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 08:13:21,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:13:21,572 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:13:21,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,577 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:21,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:21,577 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,578 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714c73424f31a94411e81a98498a3528eb4, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307144889f373e51746d4bc2ec9c4acf0f116] mob files 2023-07-14 08:13:21,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714c73424f31a94411e81a98498a3528eb4 2023-07-14 08:13:21,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307144889f373e51746d4bc2ec9c4acf0f116 2023-07-14 08:13:21,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:21,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:21,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:13:21,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:13:21,592 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-14 08:13:21,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 08:13:21,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 08:13:21,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,823 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689322401244Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689322401625 (+381 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689322401625Loading Region manifests for snaptb0-testConsecutiveExports at 1689322401625Writing data manifest for snaptb0-testConsecutiveExports at 1689322401633 (+8 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689322401739 (+106 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689322401822 (+83 ms) 2023-07-14 08:13:21,829 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 08:13:21,832 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 584 msec 2023-07-14 08:13:21,851 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:13:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 08:13:21,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:13:21,854 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854 2023-07-14 08:13:21,854 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:13:21,892 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:13:21,892 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5b0c64f9, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,892 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 08:13:21,908 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:21,931 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,931 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,932 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:21,932 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,065 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-728757197241497220.jar 2023-07-14 08:13:23,066 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,066 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,146 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-6471752507273602685.jar 2023-07-14 08:13:23,147 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,147 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,148 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,148 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,148 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,149 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:23,149 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:13:23,149 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:13:23,150 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:13:23,150 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:13:23,150 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:13:23,151 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:13:23,151 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:13:23,152 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:13:23,152 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:13:23,152 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:13:23,153 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:23,153 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:23,154 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:23,154 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:23,154 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:23,155 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:23,156 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:23,817 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0002_000001 (auth:SIMPLE) 2023-07-14 08:13:24,520 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:13:24,523 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 08:13:24,525 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 08:13:24,599 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:24,599 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:24,836 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:25,383 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:13:31,294 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:33,648 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:38,942 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:40,817 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:13:40,817 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:13:40,849 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 08:13:40,849 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:13:40,850 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:13:40,851 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:13:40,856 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:13:40,856 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:13:40,856 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3fafee01 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:13:40,856 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:13:40,857 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:13:40,858 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:13:40,895 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:13:40,895 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1920fbd7, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:40,895 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 08:13:40,940 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 08:13:40,996 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,997 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,997 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:40,998 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,311 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-2658281460824114511.jar 2023-07-14 08:13:42,312 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,312 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,399 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-3034925530876805700.jar 2023-07-14 08:13:42,400 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,400 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,401 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,401 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,402 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,402 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:13:42,402 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:13:42,403 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:13:42,403 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:13:42,404 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:13:42,404 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:13:42,405 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:13:42,405 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:13:42,406 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:13:42,407 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:13:42,407 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:13:42,408 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:42,408 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:42,409 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:42,409 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:42,409 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:13:42,410 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:42,411 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:13:44,583 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:13:44,589 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 08:13:44,594 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-14 08:13:45,096 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:45,112 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:13:45,116 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0003_000001 (auth:SIMPLE) 2023-07-14 08:13:45,286 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0004_000001 (auth:SIMPLE) 2023-07-14 08:13:54,748 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0004_000001 (auth:SIMPLE) 2023-07-14 08:13:57,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0004_000001 (auth:SIMPLE) 2023-07-14 08:14:06,241 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:14:06,241 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:14:06,278 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 08:14:06,278 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:14:06,279 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:14:06,279 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:14:06,283 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:14:06,283 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:14:06,283 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@3fafee01 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 08:14:06,283 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 08:14:06,283 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/local-export-1689322401854/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 08:14:06,310 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 08:14:06,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 08:14:06,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:06,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322446319"}]},"ts":"1689322446319"} 2023-07-14 08:14:06,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:06,321 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 08:14:06,345 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 08:14:06,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, UNASSIGN}] 2023-07-14 08:14:06,352 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, UNASSIGN 2023-07-14 08:14:06,352 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, UNASSIGN 2023-07-14 08:14:06,355 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f10086fe52370c4d6b376fdfe734fed5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:06,355 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f90cb6217875d549c8eab0031b3b5eeb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:06,355 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322446355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322446355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322446355"}]},"ts":"1689322446355"} 2023-07-14 08:14:06,355 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322446355"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322446355"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322446355"}]},"ts":"1689322446355"} 2023-07-14 08:14:06,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure f10086fe52370c4d6b376fdfe734fed5, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:14:06,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure f90cb6217875d549c8eab0031b3b5eeb, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:14:06,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:06,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:14:06,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:14:06,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f10086fe52370c4d6b376fdfe734fed5, disabling compactions & flushes 2023-07-14 08:14:06,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing f90cb6217875d549c8eab0031b3b5eeb, disabling compactions & flushes 2023-07-14 08:14:06,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:14:06,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:14:06,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:14:06,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:14:06,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. after waiting 0 ms 2023-07-14 08:14:06,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. after waiting 0 ms 2023-07-14 08:14:06,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:14:06,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:14:06,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:06,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:06,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:06,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb. 2023-07-14 08:14:06,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f90cb6217875d549c8eab0031b3b5eeb: 2023-07-14 08:14:06,651 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:14:06,652 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=f90cb6217875d549c8eab0031b3b5eeb, regionState=CLOSED 2023-07-14 08:14:06,652 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322446652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322446652"}]},"ts":"1689322446652"} 2023-07-14 08:14:06,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-14 08:14:06,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure f90cb6217875d549c8eab0031b3b5eeb, server=jenkins-hbase9.apache.org,38267,1689322343329 in 294 msec 2023-07-14 08:14:06,660 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f90cb6217875d549c8eab0031b3b5eeb, UNASSIGN in 311 msec 2023-07-14 08:14:06,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:06,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:06,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5. 2023-07-14 08:14:06,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for f10086fe52370c4d6b376fdfe734fed5: 2023-07-14 08:14:06,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:14:06,684 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=f10086fe52370c4d6b376fdfe734fed5, regionState=CLOSED 2023-07-14 08:14:06,684 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689322446684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322446684"}]},"ts":"1689322446684"} 2023-07-14 08:14:06,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-14 08:14:06,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure f10086fe52370c4d6b376fdfe734fed5, server=jenkins-hbase9.apache.org,44291,1689322343258 in 333 msec 2023-07-14 08:14:06,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-14 08:14:06,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=f10086fe52370c4d6b376fdfe734fed5, UNASSIGN in 349 msec 2023-07-14 08:14:06,700 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322446700"}]},"ts":"1689322446700"} 2023-07-14 08:14:06,702 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 08:14:06,704 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 08:14:06,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 392 msec 2023-07-14 08:14:06,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 08:14:06,931 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 08:14:06,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 08:14:06,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:06,936 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:06,937 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:06,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 08:14:06,947 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 08:14:06,950 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,950 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,950 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,950 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,951 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:14:06,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:06,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:06,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:06,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 08:14:06,953 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,953 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:06,953 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,953 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:06,953 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:06,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 08:14:06,954 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:06,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 08:14:06,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/recovered.edits] 2023-07-14 08:14:06,969 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf/57319ff0e5104b939d30ea48ff141ebb to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/cf/57319ff0e5104b939d30ea48ff141ebb 2023-07-14 08:14:06,969 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:14:06,972 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/recovered.edits] 2023-07-14 08:14:06,984 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf/ac5265471678465ebce8fbdc2f0a6f4b to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/cf/ac5265471678465ebce8fbdc2f0a6f4b 2023-07-14 08:14:06,990 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5/recovered.edits/9.seqid 2023-07-14 08:14:06,991 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f10086fe52370c4d6b376fdfe734fed5 2023-07-14 08:14:06,991 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb/recovered.edits/9.seqid 2023-07-14 08:14:06,992 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testConsecutiveExports/f90cb6217875d549c8eab0031b3b5eeb 2023-07-14 08:14:06,992 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 08:14:06,992 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 08:14:06,993 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-14 08:14:06,997 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714c73424f31a94411e81a98498a3528eb4 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230714c73424f31a94411e81a98498a3528eb4 2023-07-14 08:14:06,998 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307144889f373e51746d4bc2ec9c4acf0f116 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307144889f373e51746d4bc2ec9c4acf0f116 2023-07-14 08:14:06,999 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-14 08:14:07,004 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:07,010 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 08:14:07,013 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 08:14:07,015 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:07,015 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 08:14:07,015 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322447015"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:07,016 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322447015"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:07,024 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:14:07,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f10086fe52370c4d6b376fdfe734fed5, NAME => 'testtb-testConsecutiveExports,,1689322400093.f10086fe52370c4d6b376fdfe734fed5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f90cb6217875d549c8eab0031b3b5eeb, NAME => 'testtb-testConsecutiveExports,1,1689322400093.f90cb6217875d549c8eab0031b3b5eeb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:14:07,024 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 08:14:07,025 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322447024"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:07,028 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 08:14:07,030 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 08:14:07,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 98 msec 2023-07-14 08:14:07,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 08:14:07,058 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 08:14:07,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 08:14:07,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 08:14:07,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 08:14:07,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 08:14:07,133 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=742 (was 753), OpenFileDescriptor=892 (was 918), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=973 (was 585) - SystemLoadAverage LEAK? -, ProcessCount=191 (was 189) - ProcessCount LEAK? -, AvailableMemoryMB=728 (was 799) 2023-07-14 08:14:07,133 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=742 is superior to 500 2023-07-14 08:14:07,166 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=742, OpenFileDescriptor=892, MaxFileDescriptor=60000, SystemLoadAverage=973, ProcessCount=191, AvailableMemoryMB=725 2023-07-14 08:14:07,166 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=742 is superior to 500 2023-07-14 08:14:07,168 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 08:14:07,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:07,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:07,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 08:14:07,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:07,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:07,177 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:07,178 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:07,179 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e empty. 2023-07-14 08:14:07,180 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:07,181 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 empty. 2023-07-14 08:14:07,182 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:07,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 08:14:07,219 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:07,222 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3844f9aa9cdebca3479eb561d598594e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:14:07,225 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7a13f4e4946823c70c130a306b69a750, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:14:07,262 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:07,264 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 3844f9aa9cdebca3479eb561d598594e, disabling compactions & flushes 2023-07-14 08:14:07,267 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:07,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:07,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. after waiting 0 ms 2023-07-14 08:14:07,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:07,267 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:07,267 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 3844f9aa9cdebca3479eb561d598594e: 2023-07-14 08:14:07,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:07,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:07,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:07,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 7a13f4e4946823c70c130a306b69a750, disabling compactions & flushes 2023-07-14 08:14:07,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:07,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:07,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. after waiting 0 ms 2023-07-14 08:14:07,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:07,683 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:07,683 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 7a13f4e4946823c70c130a306b69a750: 2023-07-14 08:14:07,689 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:07,693 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322447693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322447693"}]},"ts":"1689322447693"} 2023-07-14 08:14:07,693 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322447693"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322447693"}]},"ts":"1689322447693"} 2023-07-14 08:14:07,738 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:07,740 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:07,740 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322447740"}]},"ts":"1689322447740"} 2023-07-14 08:14:07,742 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 08:14:07,750 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:07,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:07,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:07,751 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:07,752 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:07,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, ASSIGN}] 2023-07-14 08:14:07,756 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, ASSIGN 2023-07-14 08:14:07,756 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, ASSIGN 2023-07-14 08:14:07,761 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38267,1689322343329; forceNewPlan=false, retain=false 2023-07-14 08:14:07,761 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44291,1689322343258; forceNewPlan=false, retain=false 2023-07-14 08:14:07,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:07,911 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:07,914 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3844f9aa9cdebca3479eb561d598594e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:07,914 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=7a13f4e4946823c70c130a306b69a750, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:07,915 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322447914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322447914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322447914"}]},"ts":"1689322447914"} 2023-07-14 08:14:07,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322447914"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322447914"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322447914"}]},"ts":"1689322447914"} 2023-07-14 08:14:07,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 7a13f4e4946823c70c130a306b69a750, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:14:07,921 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 3844f9aa9cdebca3479eb561d598594e, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:14:08,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:08,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a13f4e4946823c70c130a306b69a750, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:14:08,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. service=AccessControlService 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3844f9aa9cdebca3479eb561d598594e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:14:08,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. service=AccessControlService 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:08,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,086 INFO [StoreOpener-3844f9aa9cdebca3479eb561d598594e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,089 INFO [StoreOpener-7a13f4e4946823c70c130a306b69a750-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,093 DEBUG [StoreOpener-3844f9aa9cdebca3479eb561d598594e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf 2023-07-14 08:14:08,093 DEBUG [StoreOpener-3844f9aa9cdebca3479eb561d598594e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf 2023-07-14 08:14:08,093 DEBUG [StoreOpener-7a13f4e4946823c70c130a306b69a750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf 2023-07-14 08:14:08,095 DEBUG [StoreOpener-7a13f4e4946823c70c130a306b69a750-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf 2023-07-14 08:14:08,096 INFO [StoreOpener-7a13f4e4946823c70c130a306b69a750-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a13f4e4946823c70c130a306b69a750 columnFamilyName cf 2023-07-14 08:14:08,098 INFO [StoreOpener-3844f9aa9cdebca3479eb561d598594e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3844f9aa9cdebca3479eb561d598594e columnFamilyName cf 2023-07-14 08:14:08,110 INFO [StoreOpener-7a13f4e4946823c70c130a306b69a750-1] regionserver.HStore(310): Store=7a13f4e4946823c70c130a306b69a750/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:08,112 INFO [StoreOpener-3844f9aa9cdebca3479eb561d598594e-1] regionserver.HStore(310): Store=3844f9aa9cdebca3479eb561d598594e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:08,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:08,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:08,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:08,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 3844f9aa9cdebca3479eb561d598594e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67869780, jitterRate=0.011338531970977783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:08,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:08,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 3844f9aa9cdebca3479eb561d598594e: 2023-07-14 08:14:08,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7a13f4e4946823c70c130a306b69a750; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65703584, jitterRate=-0.020940303802490234}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:08,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7a13f4e4946823c70c130a306b69a750: 2023-07-14 08:14:08,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e., pid=61, masterSystemTime=1689322448077 2023-07-14 08:14:08,134 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750., pid=60, masterSystemTime=1689322448076 2023-07-14 08:14:08,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:08,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=3844f9aa9cdebca3479eb561d598594e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:08,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322448137"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322448137"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322448137"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322448137"}]},"ts":"1689322448137"} 2023-07-14 08:14:08,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:08,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:08,138 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=7a13f4e4946823c70c130a306b69a750, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,140 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322448138"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322448138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322448138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322448138"}]},"ts":"1689322448138"} 2023-07-14 08:14:08,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-14 08:14:08,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 3844f9aa9cdebca3479eb561d598594e, server=jenkins-hbase9.apache.org,44291,1689322343258 in 222 msec 2023-07-14 08:14:08,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-14 08:14:08,152 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 7a13f4e4946823c70c130a306b69a750, server=jenkins-hbase9.apache.org,38267,1689322343329 in 225 msec 2023-07-14 08:14:08,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, ASSIGN in 396 msec 2023-07-14 08:14:08,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-14 08:14:08,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, ASSIGN in 405 msec 2023-07-14 08:14:08,162 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:08,162 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322448162"}]},"ts":"1689322448162"} 2023-07-14 08:14:08,164 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 08:14:08,168 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:08,168 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 08:14:08,171 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 08:14:08,173 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,173 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,173 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,173 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:08,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,183 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,184 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 1.0080 sec 2023-07-14 08:14:08,185 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:08,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 08:14:08,285 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 08:14:08,289 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,289 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:08,291 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:08,307 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 08:14:08,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:08,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322448327 (current time:1689322448327). 2023-07-14 08:14:08,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:08,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x4ad3f188 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:08,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79b5ae35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:08,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:08,361 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:08,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ad3f188 to 127.0.0.1:53917 2023-07-14 08:14:08,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:08,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x54834a9d to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:08,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@189ae34, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:08,402 DEBUG [hconnection-0x55196c36-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:08,403 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:08,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x54834a9d to 127.0.0.1:53917 2023-07-14 08:14:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 08:14:08,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:08,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:08,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:08,424 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:08,428 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689323048428 2023-07-14 08:14:08,428 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:08,429 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:08,429 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:08,444 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:08,447 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:08,447 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 29 msec 2023-07-14 08:14:08,449 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:08,450 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689323048450 2023-07-14 08:14:08,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,506 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 08:14:08,506 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:08,511 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 08:14:08,511 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 08:14:08,520 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,520 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,523 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:08,523 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:08,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:08,523 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:08,524 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,524 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,525 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,525 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 08:14:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,525 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:08,525 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 08:14:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,526 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,525 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:08,526 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:08,526 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 08:14:08,526 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,526 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:08,529 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:08,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,530 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:08,530 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:08,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:08,530 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:08,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,535 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:08,535 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:08,537 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:08,537 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:08,537 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:08,537 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:08,537 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:08,537 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:08,538 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:08,554 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:08,554 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:08,556 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,557 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,557 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,557 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,557 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:08,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:08,558 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,558 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:08,558 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:08,558 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:08,559 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,559 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:08,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d4907c3[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:08,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:08,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:08,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:08,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d4907c3[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:08,565 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 08:14:08,566 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:08,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:08,567 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,567 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,567 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:08,568 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:14:08,568 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:08,576 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:08,576 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:08,577 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:08,577 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. started... 2023-07-14 08:14:08,577 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:08,577 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:08,577 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:08,580 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a13f4e4946823c70c130a306b69a750: 2023-07-14 08:14:08,580 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,581 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:08,581 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:08,581 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,581 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:08,586 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:08,586 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:08,586 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:08,586 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. started... 2023-07-14 08:14:08,586 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3844f9aa9cdebca3479eb561d598594e: 2023-07-14 08:14:08,586 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,587 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:08,587 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:08,714 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. completed. 2023-07-14 08:14:08,714 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:08,714 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. completed. 2023-07-14 08:14:08,715 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:08,714 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:08,715 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:14:08,717 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,717 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:08,717 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:08,717 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:08,719 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:08,719 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,719 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:08,719 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:14:08,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 08:14:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,731 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:08,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,732 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:14:08,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 08:14:08,735 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 08:14:08,735 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:08,735 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:08,735 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,735 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:08,736 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,737 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:08,737 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:08,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:08,737 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,738 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:08,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,738 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:08,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:08,739 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,741 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:08,741 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,741 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,746 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:08,747 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:08,746 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:08,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:08,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:08,747 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:08,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,747 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:08,747 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:08,747 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:08,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:08,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:08,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:08,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:08,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:08,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:14:08,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:08,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 08:14:08,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:08,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:09,032 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:09,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:09,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:09,034 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:14:09,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:09,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:09,397 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:09,535 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:09,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:09,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:09,537 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 08:14:09,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 08:14:09,647 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:09,648 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:09,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689322448428Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689322449205 (+777 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322449206 (+1 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322449206Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322449233 (+27 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689322449362 (+129 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689322449647 (+285 ms) 2023-07-14 08:14:09,652 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:09,655 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2120 sec 2023-07-14 08:14:10,537 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:10,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:10,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:10,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38267] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:10,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44291] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:10,561 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,562 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:10,562 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:10,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:10,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322450578 (current time:1689322450578). 2023-07-14 08:14:10,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:10,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x06f1b51e to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:10,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48c44668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:10,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:10,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:10,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06f1b51e to 127.0.0.1:53917 2023-07-14 08:14:10,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:10,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x23fe1239 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:10,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@282c1a1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:10,645 DEBUG [hconnection-0x42b1ee76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:10,651 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:10,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23fe1239 to 127.0.0.1:53917 2023-07-14 08:14:10,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:10,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 08:14:10,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:10,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:10,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:10,688 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:10,689 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689323050689 2023-07-14 08:14:10,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 08:14:10,690 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,693 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:10,693 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:10,695 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 08:14:10,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:10,696 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-14 08:14:10,698 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:10,699 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689323050699 2023-07-14 08:14:10,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,745 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 08:14:10,745 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,747 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 08:14:10,747 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 08:14:10,748 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,748 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:10,750 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:10,749 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:10,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:10,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:10,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:10,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:10,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:10,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:10,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,752 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,752 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,752 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,752 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:10,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,757 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 08:14:10,761 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,762 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:10,762 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,764 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:10,764 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:10,764 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:10,766 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,771 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,771 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:10,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,783 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:10,783 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,785 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 08:14:10,785 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:10,787 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:10,787 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:10,787 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:10,787 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 08:14:10,787 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 08:14:10,787 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 08:14:10,790 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,790 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,790 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,790 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:10,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:10,791 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,791 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:10,791 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,791 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:10,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:10,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:10,794 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:10,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:10,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2cb5a5[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:10,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:10,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:10,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,797 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:10,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:10,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 08:14:10,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b2cb5a5[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:10,798 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 08:14:10,798 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,800 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,800 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,800 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,801 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:10,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:10,801 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:10,801 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 08:14:10,801 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:10,801 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:10,801 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:14:10,802 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:10,802 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:10,803 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:10,803 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:10,803 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:10,813 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:10,813 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:10,814 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:10,814 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:10,814 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:10,814 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. started... 2023-07-14 08:14:10,814 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7a13f4e4946823c70c130a306b69a750 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-14 08:14:10,814 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:10,816 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. started... 2023-07-14 08:14:10,816 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3844f9aa9cdebca3479eb561d598594e 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-14 08:14:10,997 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:11,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:11,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:11,001 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:11,004 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023071455a4a967127947759a7a742d097bdbd1 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071455a4a967127947759a7a742d097bdbd1 2023-07-14 08:14:11,055 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/.tmp/cf/77ed580f2f264fa6a5181921f38a5c4a 2023-07-14 08:14:11,072 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/.tmp/cf/77ed580f2f264fa6a5181921f38a5c4a as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf/77ed580f2f264fa6a5181921f38a5c4a 2023-07-14 08:14:11,100 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf/77ed580f2f264fa6a5181921f38a5c4a, entries=2, sequenceid=6, filesize=5.3 K 2023-07-14 08:14:11,102 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 3844f9aa9cdebca3479eb561d598594e in 286ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:11,104 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3844f9aa9cdebca3479eb561d598594e: 2023-07-14 08:14:11,104 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,104 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:11,104 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf/77ed580f2f264fa6a5181921f38a5c4a] hfiles 2023-07-14 08:14:11,104 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf/77ed580f2f264fa6a5181921f38a5c4a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,187 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. completed. 2023-07-14 08:14:11,187 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:11,187 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:11,189 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:11,189 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,189 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:11,189 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:14:11,191 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,191 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:11,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:11,191 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:11,191 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:11,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:11,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:14:11,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 08:14:11,302 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:11,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:11,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:11,303 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:14:11,329 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0004_000001 (auth:SIMPLE) 2023-07-14 08:14:11,374 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714d9fbcb7ef2df4dac9b961524f1b7911f to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714d9fbcb7ef2df4dac9b961524f1b7911f 2023-07-14 08:14:11,412 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/.tmp/cf/e577c73a4d2146a48f43816f5397f0cd 2023-07-14 08:14:11,419 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/.tmp/cf/e577c73a4d2146a48f43816f5397f0cd as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf/e577c73a4d2146a48f43816f5397f0cd 2023-07-14 08:14:11,431 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf/e577c73a4d2146a48f43816f5397f0cd, entries=48, sequenceid=6, filesize=13.7 K 2023-07-14 08:14:11,433 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 7a13f4e4946823c70c130a306b69a750 in 619ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:11,433 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7a13f4e4946823c70c130a306b69a750: 2023-07-14 08:14:11,433 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,433 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:11,433 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf/e577c73a4d2146a48f43816f5397f0cd] hfiles 2023-07-14 08:14:11,433 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf/e577c73a4d2146a48f43816f5397f0cd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,482 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. completed. 2023-07-14 08:14:11,482 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:11,482 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:11,484 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:11,484 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,484 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 08:14:11,484 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:14:11,488 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 08:14:11,488 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,488 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:11,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,488 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 08:14:11,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:11,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:11,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:11,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:11,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:11,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:14:11,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 08:14:11,500 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 08:14:11,500 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:11,500 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:11,500 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,500 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:11,726 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,726 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,726 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,726 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,726 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:11,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:11,726 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,727 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:11,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,728 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:11,729 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,730 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:11,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,733 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,733 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,734 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,803 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:11,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:11,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:11,805 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 08:14:11,825 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:11,826 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:11,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,828 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:11,826 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:11,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:11,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,829 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:14:11,828 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,829 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:11,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:11,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714d9fbcb7ef2df4dac9b961524f1b7911f, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071455a4a967127947759a7a742d097bdbd1] mob files 2023-07-14 08:14:11,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714d9fbcb7ef2df4dac9b961524f1b7911f 2023-07-14 08:14:11,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071455a4a967127947759a7a742d097bdbd1 2023-07-14 08:14:11,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,875 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:11,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:12,176 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 08:14:12,176 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:12,177 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:12,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689322450690Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689322451874 (+1184 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689322451874Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689322451874Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689322451889 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689322451927 (+38 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689322452176 (+249 ms) 2023-07-14 08:14:12,180 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 08:14:12,186 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.4910 sec 2023-07-14 08:14:12,251 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:14:12,805 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:12,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 08:14:12,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:12,854 DEBUG [Listener at jenkins-hbase9.apache.org/33489] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:14:12,864 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:14:12,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38267] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 08:14:12,867 DEBUG [Listener at jenkins-hbase9.apache.org/33489] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:14:12,872 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:50306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:14:12,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39577] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 08:14:12,873 DEBUG [Listener at jenkins-hbase9.apache.org/33489] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 08:14:12,900 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57304, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 08:14:12,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44291] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 08:14:12,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 08:14:12,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:12,908 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:12,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 08:14:12,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:12,911 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:12,926 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:12,930 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff empty. 2023-07-14 08:14:12,930 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:12,931 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba empty. 2023-07-14 08:14:12,932 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:12,935 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:12,936 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 08:14:12,980 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:12,989 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => c81d9901d855df03e47504b8d745f8ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:14:12,991 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => d15a2c7409b8a819290a6ab3df30efba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:14:13,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:13,099 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:13,100 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing d15a2c7409b8a819290a6ab3df30efba, disabling compactions & flushes 2023-07-14 08:14:13,100 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,100 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,100 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. after waiting 0 ms 2023-07-14 08:14:13,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,101 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,101 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for d15a2c7409b8a819290a6ab3df30efba: 2023-07-14 08:14:13,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:13,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing c81d9901d855df03e47504b8d745f8ff, disabling compactions & flushes 2023-07-14 08:14:13,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. after waiting 0 ms 2023-07-14 08:14:13,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,104 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,104 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for c81d9901d855df03e47504b8d745f8ff: 2023-07-14 08:14:13,108 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:13,110 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322453110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322453110"}]},"ts":"1689322453110"} 2023-07-14 08:14:13,110 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322453110"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322453110"}]},"ts":"1689322453110"} 2023-07-14 08:14:13,122 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:13,123 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:13,123 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322453123"}]},"ts":"1689322453123"} 2023-07-14 08:14:13,125 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 08:14:13,205 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:13,207 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:13,207 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:13,207 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:13,207 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:13,207 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, ASSIGN}] 2023-07-14 08:14:13,210 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, ASSIGN 2023-07-14 08:14:13,211 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, ASSIGN 2023-07-14 08:14:13,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:13,257 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39577,1689322343153; forceNewPlan=false, retain=false 2023-07-14 08:14:13,257 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38267,1689322343329; forceNewPlan=false, retain=false 2023-07-14 08:14:13,408 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:13,411 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c81d9901d855df03e47504b8d745f8ff, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:13,412 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322453411"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322453411"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322453411"}]},"ts":"1689322453411"} 2023-07-14 08:14:13,412 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d15a2c7409b8a819290a6ab3df30efba, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:13,412 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322453412"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322453412"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322453412"}]},"ts":"1689322453412"} 2023-07-14 08:14:13,419 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure c81d9901d855df03e47504b8d745f8ff, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:14:13,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure d15a2c7409b8a819290a6ab3df30efba, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:14:13,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:13,581 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d15a2c7409b8a819290a6ab3df30efba, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 08:14:13,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. service=AccessControlService 2023-07-14 08:14:13,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:13,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:13,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,583 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c81d9901d855df03e47504b8d745f8ff, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 08:14:13,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. service=AccessControlService 2023-07-14 08:14:13,584 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:13,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:13,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,585 INFO [StoreOpener-c81d9901d855df03e47504b8d745f8ff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,587 DEBUG [StoreOpener-c81d9901d855df03e47504b8d745f8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf 2023-07-14 08:14:13,587 DEBUG [StoreOpener-c81d9901d855df03e47504b8d745f8ff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf 2023-07-14 08:14:13,588 INFO [StoreOpener-c81d9901d855df03e47504b8d745f8ff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c81d9901d855df03e47504b8d745f8ff columnFamilyName cf 2023-07-14 08:14:13,588 INFO [StoreOpener-c81d9901d855df03e47504b8d745f8ff-1] regionserver.HStore(310): Store=c81d9901d855df03e47504b8d745f8ff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:13,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,591 INFO [StoreOpener-d15a2c7409b8a819290a6ab3df30efba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,594 DEBUG [StoreOpener-d15a2c7409b8a819290a6ab3df30efba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf 2023-07-14 08:14:13,594 DEBUG [StoreOpener-d15a2c7409b8a819290a6ab3df30efba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf 2023-07-14 08:14:13,594 INFO [StoreOpener-d15a2c7409b8a819290a6ab3df30efba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d15a2c7409b8a819290a6ab3df30efba columnFamilyName cf 2023-07-14 08:14:13,595 INFO [StoreOpener-d15a2c7409b8a819290a6ab3df30efba-1] regionserver.HStore(310): Store=d15a2c7409b8a819290a6ab3df30efba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:13,596 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:13,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:13,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:13,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d15a2c7409b8a819290a6ab3df30efba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63545768, jitterRate=-0.05309426784515381}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:13,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d15a2c7409b8a819290a6ab3df30efba: 2023-07-14 08:14:13,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba., pid=70, masterSystemTime=1689322453573 2023-07-14 08:14:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:13,610 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=d15a2c7409b8a819290a6ab3df30efba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:13,610 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322453610"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322453610"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322453610"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322453610"}]},"ts":"1689322453610"} 2023-07-14 08:14:13,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:13,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c81d9901d855df03e47504b8d745f8ff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68200341, jitterRate=0.01626427471637726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c81d9901d855df03e47504b8d745f8ff: 2023-07-14 08:14:13,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff., pid=69, masterSystemTime=1689322453572 2023-07-14 08:14:13,618 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-14 08:14:13,620 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure d15a2c7409b8a819290a6ab3df30efba, server=jenkins-hbase9.apache.org,38267,1689322343329 in 192 msec 2023-07-14 08:14:13,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:13,624 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=c81d9901d855df03e47504b8d745f8ff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:13,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322453624"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322453624"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322453624"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322453624"}]},"ts":"1689322453624"} 2023-07-14 08:14:13,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, ASSIGN in 413 msec 2023-07-14 08:14:13,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-14 08:14:13,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure c81d9901d855df03e47504b8d745f8ff, server=jenkins-hbase9.apache.org,39577,1689322343153 in 207 msec 2023-07-14 08:14:13,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 08:14:13,635 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, ASSIGN in 426 msec 2023-07-14 08:14:13,636 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:13,636 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322453636"}]},"ts":"1689322453636"} 2023-07-14 08:14:13,637 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 08:14:13,711 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:13,712 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 08:14:13,716 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 08:14:13,725 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:13,725 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:13,725 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:13,725 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:13,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,764 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,765 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:13,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 862 msec 2023-07-14 08:14:14,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 08:14:14,022 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 08:14:14,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions c81d9901d855df03e47504b8d745f8ff, d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:14,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c81d9901d855df03e47504b8d745f8ff, d15a2c7409b8a819290a6ab3df30efba], force=true 2023-07-14 08:14:14,099 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c81d9901d855df03e47504b8d745f8ff, d15a2c7409b8a819290a6ab3df30efba], force=true 2023-07-14 08:14:14,100 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c81d9901d855df03e47504b8d745f8ff, d15a2c7409b8a819290a6ab3df30efba], force=true 2023-07-14 08:14:14,100 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c81d9901d855df03e47504b8d745f8ff, d15a2c7409b8a819290a6ab3df30efba], force=true 2023-07-14 08:14:14,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:14,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, UNASSIGN}] 2023-07-14 08:14:14,159 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, UNASSIGN 2023-07-14 08:14:14,160 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, UNASSIGN 2023-07-14 08:14:14,162 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d15a2c7409b8a819290a6ab3df30efba, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:14,162 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c81d9901d855df03e47504b8d745f8ff, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:14,162 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322454162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322454162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322454162"}]},"ts":"1689322454162"} 2023-07-14 08:14:14,162 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322454162"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322454162"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322454162"}]},"ts":"1689322454162"} 2023-07-14 08:14:14,164 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure d15a2c7409b8a819290a6ab3df30efba, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:14:14,165 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure c81d9901d855df03e47504b8d745f8ff, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:14:14,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:14,308 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 08:14:14,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:14,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d15a2c7409b8a819290a6ab3df30efba, disabling compactions & flushes 2023-07-14 08:14:14,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:14,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:14,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. after waiting 0 ms 2023-07-14 08:14:14,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:14,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing d15a2c7409b8a819290a6ab3df30efba 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 08:14:14,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:14,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c81d9901d855df03e47504b8d745f8ff, disabling compactions & flushes 2023-07-14 08:14:14,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:14,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:14,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. after waiting 0 ms 2023-07-14 08:14:14,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:14,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing c81d9901d855df03e47504b8d745f8ff 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 08:14:14,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/.tmp/cf/f5b91e7f768a4a939144d285e02e23ea 2023-07-14 08:14:14,373 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/.tmp/cf/f5b91e7f768a4a939144d285e02e23ea as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf/f5b91e7f768a4a939144d285e02e23ea 2023-07-14 08:14:14,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/.tmp/cf/c6e513a2391e480396696ec4232c0d65 2023-07-14 08:14:14,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf/f5b91e7f768a4a939144d285e02e23ea, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 08:14:14,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for d15a2c7409b8a819290a6ab3df30efba in 88ms, sequenceid=5, compaction requested=false 2023-07-14 08:14:14,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:14,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/.tmp/cf/c6e513a2391e480396696ec4232c0d65 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf/c6e513a2391e480396696ec4232c0d65 2023-07-14 08:14:14,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 08:14:14,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:14,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba. 2023-07-14 08:14:14,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d15a2c7409b8a819290a6ab3df30efba: 2023-07-14 08:14:14,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf/c6e513a2391e480396696ec4232c0d65, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 08:14:14,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c81d9901d855df03e47504b8d745f8ff in 132ms, sequenceid=5, compaction requested=false 2023-07-14 08:14:14,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:14,454 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=d15a2c7409b8a819290a6ab3df30efba, regionState=CLOSED 2023-07-14 08:14:14,454 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322454452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322454452"}]},"ts":"1689322454452"} 2023-07-14 08:14:14,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-14 08:14:14,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure d15a2c7409b8a819290a6ab3df30efba, server=jenkins-hbase9.apache.org,38267,1689322343329 in 294 msec 2023-07-14 08:14:14,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d15a2c7409b8a819290a6ab3df30efba, UNASSIGN in 303 msec 2023-07-14 08:14:14,486 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 08:14:14,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:14,487 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff. 2023-07-14 08:14:14,487 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c81d9901d855df03e47504b8d745f8ff: 2023-07-14 08:14:14,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:14,489 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c81d9901d855df03e47504b8d745f8ff, regionState=CLOSED 2023-07-14 08:14:14,489 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689322454489"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322454489"}]},"ts":"1689322454489"} 2023-07-14 08:14:14,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-14 08:14:14,493 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure c81d9901d855df03e47504b8d745f8ff, server=jenkins-hbase9.apache.org,39577,1689322343153 in 326 msec 2023-07-14 08:14:14,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-14 08:14:14,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c81d9901d855df03e47504b8d745f8ff, UNASSIGN in 340 msec 2023-07-14 08:14:14,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:15,118 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 08:14:15,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452903.c81d9901d855df03e47504b8d745f8ff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:15,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689322452903.d15a2c7409b8a819290a6ab3df30efba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:15,122 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:15,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:15,259 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, ASSIGN}] 2023-07-14 08:14:15,262 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, ASSIGN 2023-07-14 08:14:15,263 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,39577,1689322343153; forceNewPlan=false, retain=false 2023-07-14 08:14:15,413 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 08:14:15,415 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8926225ad894137027762abf3acd9889, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:15,416 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322455415"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322455415"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322455415"}]},"ts":"1689322455415"} 2023-07-14 08:14:15,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 8926225ad894137027762abf3acd9889, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:14:15,589 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:15,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8926225ad894137027762abf3acd9889, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.', STARTKEY => '', ENDKEY => ''} 2023-07-14 08:14:15,589 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. service=AccessControlService 2023-07-14 08:14:15,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:15,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:15,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/.regioninfo 2023-07-14 08:14:15,664 INFO [StoreOpener-8926225ad894137027762abf3acd9889-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,667 DEBUG [StoreOpener-8926225ad894137027762abf3acd9889-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf 2023-07-14 08:14:15,667 DEBUG [StoreOpener-8926225ad894137027762abf3acd9889-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf 2023-07-14 08:14:15,667 INFO [StoreOpener-8926225ad894137027762abf3acd9889-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8926225ad894137027762abf3acd9889 columnFamilyName cf 2023-07-14 08:14:15,729 DEBUG [StoreOpener-8926225ad894137027762abf3acd9889-1] regionserver.HStore(539): loaded hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/c6e513a2391e480396696ec4232c0d65.c81d9901d855df03e47504b8d745f8ff->hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf/c6e513a2391e480396696ec4232c0d65-top 2023-07-14 08:14:15,739 DEBUG [StoreOpener-8926225ad894137027762abf3acd9889-1] regionserver.HStore(539): loaded hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/f5b91e7f768a4a939144d285e02e23ea.d15a2c7409b8a819290a6ab3df30efba->hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf/f5b91e7f768a4a939144d285e02e23ea-top 2023-07-14 08:14:15,740 INFO [StoreOpener-8926225ad894137027762abf3acd9889-1] regionserver.HStore(310): Store=8926225ad894137027762abf3acd9889/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:15,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8926225ad894137027762abf3acd9889 2023-07-14 08:14:15,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8926225ad894137027762abf3acd9889; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71767317, jitterRate=0.0694163590669632}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:15,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8926225ad894137027762abf3acd9889: 2023-07-14 08:14:15,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889., pid=77, masterSystemTime=1689322455573 2023-07-14 08:14:15,753 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.,because compaction is disabled. 2023-07-14 08:14:15,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:15,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:15,757 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8926225ad894137027762abf3acd9889, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:15,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322455757"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322455757"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322455757"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322455757"}]},"ts":"1689322455757"} 2023-07-14 08:14:15,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 08:14:15,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 8926225ad894137027762abf3acd9889, server=jenkins-hbase9.apache.org,39577,1689322343153 in 339 msec 2023-07-14 08:14:15,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 08:14:15,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, ASSIGN in 503 msec 2023-07-14 08:14:15,771 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[c81d9901d855df03e47504b8d745f8ff, d15a2c7409b8a819290a6ab3df30efba], force=true in 1.6830 sec 2023-07-14 08:14:16,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 08:14:16,217 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 08:14:16,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 08:14:16,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322456219 (current time:1689322456219). 2023-07-14 08:14:16,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:16,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x018f7ee9 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:16,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ffb8fef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:16,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:16,299 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:16,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x018f7ee9 to 127.0.0.1:53917 2023-07-14 08:14:16,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:16,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x58c687b6 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:16,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22c4d271, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:16,373 DEBUG [hconnection-0x7113b531-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:16,375 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:51854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:16,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58c687b6 to 127.0.0.1:53917 2023-07-14 08:14:16,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:16,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 08:14:16,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:16,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 08:14:16,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 08:14:16,395 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 08:14:16,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 08:14:16,396 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,396 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689323056396 2023-07-14 08:14:16,403 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:16,403 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:16,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 08:14:16,408 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 08:14:16,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 16 msec 2023-07-14 08:14:16,416 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 08:14:16,416 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689323056416 2023-07-14 08:14:16,437 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,438 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 08:14:16,438 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:16,443 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 08:14:16,443 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 08:14:16,443 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,444 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:16,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:16,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:16,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:16,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:16,494 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,495 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,495 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:16,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,496 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 08:14:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,497 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 08:14:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 08:14:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,498 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,498 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 08:14:16,498 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 08:14:16,498 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,502 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 08:14:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,503 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 08:14:16,503 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:16,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:16,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:16,505 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:16,507 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,507 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 08:14:16,507 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:16,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,510 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 08:14:16,511 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 08:14:16,511 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 08:14:16,510 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 08:14:16,511 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 08:14:16,511 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 08:14:16,512 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 08:14:16,512 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:16,514 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 08:14:16,514 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 08:14:16,514 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 08:14:16,541 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,541 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,603 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,603 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:16,603 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,603 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,603 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:16,603 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:16,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:16,604 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,604 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:16,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:16,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:16,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:16,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 08:14:16,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d42f44e[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:16,608 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 08:14:16,608 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,679 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,679 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 08:14:16,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 08:14:16,679 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:16,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:14:16,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:16,680 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:16,680 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:16,681 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. started... 2023-07-14 08:14:16,683 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8926225ad894137027762abf3acd9889: 2023-07-14 08:14:16,683 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,683 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:16,683 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/c6e513a2391e480396696ec4232c0d65.c81d9901d855df03e47504b8d745f8ff->hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf/c6e513a2391e480396696ec4232c0d65-top, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/f5b91e7f768a4a939144d285e02e23ea.d15a2c7409b8a819290a6ab3df30efba->hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf/f5b91e7f768a4a939144d285e02e23ea-top] hfiles 2023-07-14 08:14:16,683 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/c6e513a2391e480396696ec4232c0d65.c81d9901d855df03e47504b8d745f8ff for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,684 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/f5b91e7f768a4a939144d285e02e23ea.d15a2c7409b8a819290a6ab3df30efba for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,697 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. completed. 2023-07-14 08:14:16,697 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:16,697 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:16,699 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:16,699 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,699 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 08:14:16,699 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:14:16,705 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:16,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:16,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:16,708 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:16,710 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 08:14:16,710 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:16,710 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 08:14:16,753 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 08:14:16,754 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:16,754 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 08:14:16,911 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 08:14:16,911 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:16,911 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 08:14:16,914 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:16,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:16,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:14:16,919 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 08:14:16,919 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 08:14:16,920 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:16,920 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:16,920 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,920 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:16,971 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,971 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:16,971 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,971 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:16,972 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:16,972 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,972 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:16,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,973 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,973 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,974 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:16,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:16,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:16,977 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,979 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:16,979 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,980 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:16,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:16,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:16,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:16,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:17,008 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:17,010 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:17,010 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:17,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:17,010 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:17,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:17,011 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:17,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:17,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:17,010 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:17,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:17,011 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,011 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,012 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,012 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:14:17,013 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:17,013 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:17,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:17,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:17,018 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:17,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:17,478 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,513 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:17,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:17,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:17,514 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 08:14:17,622 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 08:14:17,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,623 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:17,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689322456396Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322457012 (+616 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322457012Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322457030 (+18 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689322457464 (+434 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689322457622 (+158 ms) 2023-07-14 08:14:17,631 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 08:14:17,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 1.2290 sec 2023-07-14 08:14:18,515 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:18,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 08:14:18,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:18,519 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519 2023-07-14 08:14:18,519 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43813, tgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519, rawTgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:14:18,556 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:14:18,556 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-395883550_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:18,557 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 08:14:18,582 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:18,739 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:18,740 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:18,740 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:18,741 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:19,087 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:14:20,170 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-1321803028143997503.jar 2023-07-14 08:14:20,170 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,171 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,270 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-744778497458736691.jar 2023-07-14 08:14:20,270 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,271 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,272 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,272 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,273 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,273 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:20,274 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:14:20,274 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:14:20,275 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:14:20,276 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:14:20,276 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:14:20,276 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:14:20,277 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:14:20,277 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:14:20,278 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:14:20,278 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:14:20,279 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:20,279 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:20,280 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:20,280 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:20,281 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:20,281 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:20,282 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:22,565 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:14:22,569 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 08:14:22,576 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 08:14:22,820 WARN [DataStreamer for file /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689322353275_0005/job.xml] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-14 08:14:22,879 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:22,879 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:22,920 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:32,582 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:35,081 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:42,134 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:14:42,144 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:14:42,188 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,189 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:14:42,190 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:14:42,190 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,191 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 08:14:42,191 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 08:14:42,191 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,192 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 08:14:42,192 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322458519/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 08:14:42,223 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322482237"}]},"ts":"1689322482237"} 2023-07-14 08:14:42,239 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 08:14:42,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 08:14:42,243 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 08:14:42,244 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, UNASSIGN}] 2023-07-14 08:14:42,245 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, UNASSIGN 2023-07-14 08:14:42,248 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8926225ad894137027762abf3acd9889, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:42,248 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322482248"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322482248"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322482248"}]},"ts":"1689322482248"} 2023-07-14 08:14:42,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 8926225ad894137027762abf3acd9889, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:14:42,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 08:14:42,403 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8926225ad894137027762abf3acd9889 2023-07-14 08:14:42,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8926225ad894137027762abf3acd9889, disabling compactions & flushes 2023-07-14 08:14:42,404 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:42,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:42,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. after waiting 0 ms 2023-07-14 08:14:42,404 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:42,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 08:14:42,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:42,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889. 2023-07-14 08:14:42,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8926225ad894137027762abf3acd9889: 2023-07-14 08:14:42,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8926225ad894137027762abf3acd9889 2023-07-14 08:14:42,478 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8926225ad894137027762abf3acd9889, regionState=CLOSED 2023-07-14 08:14:42,478 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689322482478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322482478"}]},"ts":"1689322482478"} 2023-07-14 08:14:42,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 08:14:42,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 8926225ad894137027762abf3acd9889, server=jenkins-hbase9.apache.org,39577,1689322343153 in 239 msec 2023-07-14 08:14:42,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 08:14:42,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8926225ad894137027762abf3acd9889, UNASSIGN in 248 msec 2023-07-14 08:14:42,496 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322482496"}]},"ts":"1689322482496"} 2023-07-14 08:14:42,498 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 08:14:42,500 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 08:14:42,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 275 msec 2023-07-14 08:14:42,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 08:14:42,544 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 08:14:42,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,548 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,550 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,552 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,556 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,556 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 08:14:42,557 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,557 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,557 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,557 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 08:14:42,558 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:42,559 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:42,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 08:14:42,559 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:42,559 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,559 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:42,559 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 08:14:42,559 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:42,559 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,559 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:42,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:42,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:42,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:42,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 08:14:42,560 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:42,574 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889 2023-07-14 08:14:42,583 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:42,612 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:42,613 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/recovered.edits] 2023-07-14 08:14:42,617 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/recovered.edits] 2023-07-14 08:14:42,619 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/recovered.edits] 2023-07-14 08:14:42,622 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/c6e513a2391e480396696ec4232c0d65.c81d9901d855df03e47504b8d745f8ff to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/c6e513a2391e480396696ec4232c0d65.c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:42,624 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf/c6e513a2391e480396696ec4232c0d65 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/cf/c6e513a2391e480396696ec4232c0d65 2023-07-14 08:14:42,625 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/f5b91e7f768a4a939144d285e02e23ea.d15a2c7409b8a819290a6ab3df30efba to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/cf/f5b91e7f768a4a939144d285e02e23ea.d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:42,633 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf/f5b91e7f768a4a939144d285e02e23ea to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/cf/f5b91e7f768a4a939144d285e02e23ea 2023-07-14 08:14:42,645 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/recovered.edits/12.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889/recovered.edits/12.seqid 2023-07-14 08:14:42,648 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/recovered.edits/8.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba/recovered.edits/8.seqid 2023-07-14 08:14:42,647 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/recovered.edits/8.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff/recovered.edits/8.seqid 2023-07-14 08:14:42,655 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d15a2c7409b8a819290a6ab3df30efba 2023-07-14 08:14:42,657 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c81d9901d855df03e47504b8d745f8ff 2023-07-14 08:14:42,658 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8926225ad894137027762abf3acd9889 2023-07-14 08:14:42,658 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 08:14:42,663 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 08:14:42,678 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 08:14:42,693 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 08:14:42,695 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,695 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 08:14:42,695 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322482695"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:42,722 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 08:14:42,722 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8926225ad894137027762abf3acd9889, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689322452904.8926225ad894137027762abf3acd9889.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 08:14:42,722 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 08:14:42,722 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322482722"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:42,740 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 08:14:42,743 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:42,745 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 198 msec 2023-07-14 08:14:42,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 08:14:42,866 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 08:14:42,866 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:42,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:42,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:42,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:42,873 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322482873"}]},"ts":"1689322482873"} 2023-07-14 08:14:42,875 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 08:14:42,878 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 08:14:42,879 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, UNASSIGN}] 2023-07-14 08:14:42,884 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, UNASSIGN 2023-07-14 08:14:42,884 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, UNASSIGN 2023-07-14 08:14:42,885 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3844f9aa9cdebca3479eb561d598594e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:42,885 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322482885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322482885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322482885"}]},"ts":"1689322482885"} 2023-07-14 08:14:42,885 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=7a13f4e4946823c70c130a306b69a750, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:42,886 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322482885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322482885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322482885"}]},"ts":"1689322482885"} 2023-07-14 08:14:42,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 3844f9aa9cdebca3479eb561d598594e, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:14:42,897 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 7a13f4e4946823c70c130a306b69a750, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:14:42,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:43,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:43,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7a13f4e4946823c70c130a306b69a750, disabling compactions & flushes 2023-07-14 08:14:43,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:43,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 3844f9aa9cdebca3479eb561d598594e, disabling compactions & flushes 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. after waiting 0 ms 2023-07-14 08:14:43,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. after waiting 0 ms 2023-07-14 08:14:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:43,166 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:43,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:43,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750. 2023-07-14 08:14:43,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7a13f4e4946823c70c130a306b69a750: 2023-07-14 08:14:43,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:43,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:43,176 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=7a13f4e4946823c70c130a306b69a750, regionState=CLOSED 2023-07-14 08:14:43,176 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322483176"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322483176"}]},"ts":"1689322483176"} 2023-07-14 08:14:43,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-14 08:14:43,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 7a13f4e4946823c70c130a306b69a750, server=jenkins-hbase9.apache.org,38267,1689322343329 in 284 msec 2023-07-14 08:14:43,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=7a13f4e4946823c70c130a306b69a750, UNASSIGN in 306 msec 2023-07-14 08:14:43,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:14:43,191 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:14:43,193 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e. 2023-07-14 08:14:43,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 3844f9aa9cdebca3479eb561d598594e: 2023-07-14 08:14:43,197 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=3844f9aa9cdebca3479eb561d598594e, regionState=CLOSED 2023-07-14 08:14:43,197 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689322483197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322483197"}]},"ts":"1689322483197"} 2023-07-14 08:14:43,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:43,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-14 08:14:43,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 3844f9aa9cdebca3479eb561d598594e, server=jenkins-hbase9.apache.org,44291,1689322343258 in 311 msec 2023-07-14 08:14:43,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-14 08:14:43,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=3844f9aa9cdebca3479eb561d598594e, UNASSIGN in 332 msec 2023-07-14 08:14:43,215 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322483214"}]},"ts":"1689322483214"} 2023-07-14 08:14:43,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 08:14:43,219 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 08:14:43,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 354 msec 2023-07-14 08:14:43,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 08:14:43,477 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 08:14:43,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,482 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,489 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,491 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,496 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,496 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,497 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 08:14:43,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 08:14:43,500 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,500 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,500 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,500 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,500 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:43,501 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:43,501 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-14 08:14:43,501 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:43,500 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:43,503 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-14 08:14:43,503 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 08:14:43,503 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:43,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 08:14:43,518 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:43,518 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:43,520 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/recovered.edits] 2023-07-14 08:14:43,522 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/recovered.edits] 2023-07-14 08:14:43,546 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf/77ed580f2f264fa6a5181921f38a5c4a to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/cf/77ed580f2f264fa6a5181921f38a5c4a 2023-07-14 08:14:43,553 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e/recovered.edits/9.seqid 2023-07-14 08:14:43,554 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/3844f9aa9cdebca3479eb561d598594e 2023-07-14 08:14:43,570 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf/e577c73a4d2146a48f43816f5397f0cd to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/cf/e577c73a4d2146a48f43816f5397f0cd 2023-07-14 08:14:43,583 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750/recovered.edits/9.seqid 2023-07-14 08:14:43,584 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/7a13f4e4946823c70c130a306b69a750 2023-07-14 08:14:43,584 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 08:14:43,587 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 08:14:43,589 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-14 08:14:43,594 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714d9fbcb7ef2df4dac9b961524f1b7911f to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230714d9fbcb7ef2df4dac9b961524f1b7911f 2023-07-14 08:14:43,596 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071455a4a967127947759a7a742d097bdbd1 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023071455a4a967127947759a7a742d097bdbd1 2023-07-14 08:14:43,597 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-14 08:14:43,599 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 08:14:43,612 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 08:14:43,618 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 08:14:43,620 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,620 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 08:14:43,620 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322483620"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:43,620 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322483620"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:43,622 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:14:43,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3844f9aa9cdebca3479eb561d598594e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689322447168.3844f9aa9cdebca3479eb561d598594e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7a13f4e4946823c70c130a306b69a750, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689322447168.7a13f4e4946823c70c130a306b69a750.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:14:43,623 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 08:14:43,623 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322483623"}]},"ts":"9223372036854775807"} 2023-07-14 08:14:43,624 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 08:14:43,626 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 148 msec 2023-07-14 08:14:43,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 08:14:43,812 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 08:14:43,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 08:14:43,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 08:14:43,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 08:14:43,843 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 08:14:43,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 08:14:43,889 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=754 (was 742) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4230 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:57566 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1154669656) connection to jenkins-hbase9.apache.org/172.31.2.10:32779 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2136318455_1 at /127.0.0.1:41382 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:51358 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:38482 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2136318455_1 at /127.0.0.1:48692 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=896 (was 892) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1178 (was 973) - SystemLoadAverage LEAK? -, ProcessCount=186 (was 191), AvailableMemoryMB=1303 (was 725) - AvailableMemoryMB LEAK? - 2023-07-14 08:14:43,890 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-14 08:14:43,941 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=754, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=1178, ProcessCount=186, AvailableMemoryMB=1305 2023-07-14 08:14:43,941 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-14 08:14:43,943 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 08:14:43,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:14:43,950 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:14:43,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 08:14:43,953 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:14:43,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:43,962 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:43,962 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 empty. 2023-07-14 08:14:43,963 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:43,966 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:43,966 DEBUG [HFileArchiver-25] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 empty. 2023-07-14 08:14:43,967 DEBUG [HFileArchiver-25] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:43,967 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 08:14:44,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:44,157 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 08:14:44,166 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 835871a74bf9f4aac6131ec6b1b8a3f0, NAME => 'testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:14:44,175 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8230ae20414d960a2b20ca772e9a8ed9, NAME => 'testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:14:44,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:44,344 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:44,349 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8230ae20414d960a2b20ca772e9a8ed9, disabling compactions & flushes 2023-07-14 08:14:44,349 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:44,349 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:44,349 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. after waiting 0 ms 2023-07-14 08:14:44,349 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:44,349 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:44,350 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8230ae20414d960a2b20ca772e9a8ed9: 2023-07-14 08:14:44,362 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:44,362 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 835871a74bf9f4aac6131ec6b1b8a3f0, disabling compactions & flushes 2023-07-14 08:14:44,362 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:44,362 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:44,362 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. after waiting 0 ms 2023-07-14 08:14:44,362 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:44,362 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:44,362 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 835871a74bf9f4aac6131ec6b1b8a3f0: 2023-07-14 08:14:44,371 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:14:44,374 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322484374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322484374"}]},"ts":"1689322484374"} 2023-07-14 08:14:44,374 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322484374"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322484374"}]},"ts":"1689322484374"} 2023-07-14 08:14:44,377 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:14:44,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:14:44,379 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322484379"}]},"ts":"1689322484379"} 2023-07-14 08:14:44,383 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 08:14:44,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:44,676 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:14:44,677 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:14:44,678 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:14:44,678 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:14:44,678 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:14:44,678 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, ASSIGN}] 2023-07-14 08:14:44,682 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, ASSIGN 2023-07-14 08:14:44,682 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, ASSIGN 2023-07-14 08:14:44,683 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,38267,1689322343329; forceNewPlan=false, retain=false 2023-07-14 08:14:44,684 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39577,1689322343153; forceNewPlan=false, retain=false 2023-07-14 08:14:44,834 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:14:44,838 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=835871a74bf9f4aac6131ec6b1b8a3f0, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:44,838 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322484838"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322484838"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322484838"}]},"ts":"1689322484838"} 2023-07-14 08:14:44,839 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8230ae20414d960a2b20ca772e9a8ed9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:44,839 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322484839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322484839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322484839"}]},"ts":"1689322484839"} 2023-07-14 08:14:44,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 835871a74bf9f4aac6131ec6b1b8a3f0, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:14:44,841 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 8230ae20414d960a2b20ca772e9a8ed9, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:14:44,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:44,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 835871a74bf9f4aac6131ec6b1b8a3f0, NAME => 'testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:14:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. service=AccessControlService 2023-07-14 08:14:44,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:44,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:44,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:45,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8230ae20414d960a2b20ca772e9a8ed9, NAME => 'testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:14:45,008 INFO [StoreOpener-835871a74bf9f4aac6131ec6b1b8a3f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. service=AccessControlService 2023-07-14 08:14:45,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:14:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:14:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,012 DEBUG [StoreOpener-835871a74bf9f4aac6131ec6b1b8a3f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf 2023-07-14 08:14:45,012 DEBUG [StoreOpener-835871a74bf9f4aac6131ec6b1b8a3f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf 2023-07-14 08:14:45,012 INFO [StoreOpener-835871a74bf9f4aac6131ec6b1b8a3f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 835871a74bf9f4aac6131ec6b1b8a3f0 columnFamilyName cf 2023-07-14 08:14:45,013 INFO [StoreOpener-8230ae20414d960a2b20ca772e9a8ed9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,015 INFO [StoreOpener-835871a74bf9f4aac6131ec6b1b8a3f0-1] regionserver.HStore(310): Store=835871a74bf9f4aac6131ec6b1b8a3f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:45,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:45,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:45,020 DEBUG [StoreOpener-8230ae20414d960a2b20ca772e9a8ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf 2023-07-14 08:14:45,020 DEBUG [StoreOpener-8230ae20414d960a2b20ca772e9a8ed9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf 2023-07-14 08:14:45,020 INFO [StoreOpener-8230ae20414d960a2b20ca772e9a8ed9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8230ae20414d960a2b20ca772e9a8ed9 columnFamilyName cf 2023-07-14 08:14:45,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:14:45,032 INFO [StoreOpener-8230ae20414d960a2b20ca772e9a8ed9-1] regionserver.HStore(310): Store=8230ae20414d960a2b20ca772e9a8ed9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:14:45,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:45,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 835871a74bf9f4aac6131ec6b1b8a3f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62592826, jitterRate=-0.06729421019554138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:45,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 835871a74bf9f4aac6131ec6b1b8a3f0: 2023-07-14 08:14:45,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0., pid=93, masterSystemTime=1689322484994 2023-07-14 08:14:45,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:45,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:45,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:14:45,042 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=835871a74bf9f4aac6131ec6b1b8a3f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:45,042 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322485042"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322485042"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322485042"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322485042"}]},"ts":"1689322485042"} 2023-07-14 08:14:45,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:14:45,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8230ae20414d960a2b20ca772e9a8ed9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73207001, jitterRate=0.09086932241916656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:14:45,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8230ae20414d960a2b20ca772e9a8ed9: 2023-07-14 08:14:45,047 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9., pid=94, masterSystemTime=1689322484994 2023-07-14 08:14:45,049 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:45,049 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:45,049 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-14 08:14:45,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 835871a74bf9f4aac6131ec6b1b8a3f0, server=jenkins-hbase9.apache.org,39577,1689322343153 in 204 msec 2023-07-14 08:14:45,056 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8230ae20414d960a2b20ca772e9a8ed9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:45,058 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322485049"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322485049"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322485049"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322485049"}]},"ts":"1689322485049"} 2023-07-14 08:14:45,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, ASSIGN in 378 msec 2023-07-14 08:14:45,063 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-14 08:14:45,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 8230ae20414d960a2b20ca772e9a8ed9, server=jenkins-hbase9.apache.org,38267,1689322343329 in 219 msec 2023-07-14 08:14:45,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-14 08:14:45,067 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, ASSIGN in 386 msec 2023-07-14 08:14:45,067 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:14:45,067 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322485067"}]},"ts":"1689322485067"} 2023-07-14 08:14:45,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 08:14:45,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:45,185 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:14:45,186 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 08:14:45,188 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:14:45,229 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:45,229 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:45,229 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:45,230 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:14:45,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:45,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:45,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:45,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 08:14:45,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 1.3540 sec 2023-07-14 08:14:46,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 08:14:46,120 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 08:14:46,123 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:46,123 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:46,125 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:46,139 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:46,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322486139 (current time:1689322486139). 2023-07-14 08:14:46,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:46,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x03eecae8 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:46,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4be47540, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:46,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:46,223 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:46,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03eecae8 to 127.0.0.1:53917 2023-07-14 08:14:46,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:46,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x72ec1890 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:46,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a035af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:46,347 DEBUG [hconnection-0x6f060e6e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:46,352 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:46,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72ec1890 to 127.0.0.1:53917 2023-07-14 08:14:46,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:46,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:14:46,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:46,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:46,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:46,386 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:46,386 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689323086386 2023-07-14 08:14:46,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:46,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:46,388 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:46,388 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:46,389 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:46,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:46,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 29 msec 2023-07-14 08:14:46,395 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:46,396 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689323086396 2023-07-14 08:14:46,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,426 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 08:14:46,426 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:46,427 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 08:14:46,427 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:14:46,428 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,428 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,476 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:46,476 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:46,476 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:46,476 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:46,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:46,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:46,476 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,476 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,477 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,477 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 08:14:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:46,478 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:46,488 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:46,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:46,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:46,489 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:46,489 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:46,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,491 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:46,491 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:46,491 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:46,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,491 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:46,491 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:46,491 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:46,491 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:46,493 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:46,493 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:46,493 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:46,493 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:46,494 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:46,494 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:46,494 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:46,506 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,522 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,522 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:46,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:46,538 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,538 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,538 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:46,538 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:46,538 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,538 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,538 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:46,539 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2746c82f[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:46,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:46,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:46,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:46,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2746c82f[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:46,544 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:14:46,544 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:46,546 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:46,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,546 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:14:46,546 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:46,552 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:46,553 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:46,553 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:46,554 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:46,562 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:46,562 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:46,562 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:46,562 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:46,562 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. started... 2023-07-14 08:14:46,562 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. started... 2023-07-14 08:14:46,562 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 835871a74bf9f4aac6131ec6b1b8a3f0: 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8230ae20414d960a2b20ca772e9a8ed9: 2023-07-14 08:14:46,568 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:46,568 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:46,568 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:46,568 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:14:46,589 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. completed. 2023-07-14 08:14:46,589 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:46,590 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,593 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:46,594 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:14:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:46,595 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,595 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:46,596 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. completed. 2023-07-14 08:14:46,596 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:46,597 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:46,597 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:46,597 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,597 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:46,597 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:14:46,601 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:46,602 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:46,602 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,603 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:46,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:14:46,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:14:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:46,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:46,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:14:46,612 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:14:46,612 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 08:14:46,612 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:46,612 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:46,612 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,612 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:46,614 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:46,614 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:46,614 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:46,614 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:46,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,615 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:46,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:46,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:46,615 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,616 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:46,617 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:46,619 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:46,619 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,620 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:46,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:46,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,623 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:46,623 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:46,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,623 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:46,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:46,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:14:46,624 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:46,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:46,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:46,624 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:46,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:46,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:46,625 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:46,626 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,626 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 08:14:46,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:46,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:46,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,691 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:46,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:46,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:46,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,692 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:46,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 08:14:46,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,729 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:46,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689322486387Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689322486656 (+269 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689322486656Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689322486656Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689322486664 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689322486684 (+20 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689322486728 (+44 ms) 2023-07-14 08:14:46,733 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:46,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 345 msec 2023-07-14 08:14:46,993 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:46,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:46,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:46,998 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39577] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:46,999 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38267] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:14:47,007 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:47,007 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:47,008 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:14:47,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0005_000001 (auth:SIMPLE) 2023-07-14 08:14:47,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:47,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322487021 (current time:1689322487021). 2023-07-14 08:14:47,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:14:47,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x7d19cf47 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:47,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22b3dbf4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:47,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:47,032 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:47,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d19cf47 to 127.0.0.1:53917 2023-07-14 08:14:47,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:47,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x65a7d881 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:14:47,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@56f74085, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:14:47,043 DEBUG [hconnection-0x6a275dd4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:14:47,046 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:14:47,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65a7d881 to 127.0.0.1:53917 2023-07-14 08:14:47,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:14:47,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 08:14:47,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:14:47,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:47,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:47,056 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:47,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 08:14:47,057 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:47,057 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689323087057 2023-07-14 08:14:47,059 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:14:47,059 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:14:47,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:47,062 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 08:14:47,065 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 08:14:47,066 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:47,067 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689323087067 2023-07-14 08:14:47,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,078 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 08:14:47,078 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:47,080 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 08:14:47,080 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 08:14:47,080 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,080 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,086 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:47,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:47,086 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:47,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:47,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:47,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:47,086 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:47,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:47,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:47,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,087 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,087 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,087 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 08:14:47,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,088 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 08:14:47,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,087 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,088 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:47,088 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,088 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:14:47,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 08:14:47,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 08:14:47,092 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,092 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:47,092 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:47,095 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:47,095 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:47,095 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:47,095 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,095 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:47,095 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:47,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,097 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 08:14:47,097 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:47,097 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:47,097 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:47,097 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:14:47,102 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 08:14:47,102 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 08:14:47,102 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 08:14:47,105 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,105 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,105 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:47,105 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,106 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,106 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:47,108 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:47,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:47,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:47,112 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:47,112 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,112 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,112 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:14:47,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:47,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:47,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32a4b41b[Count = 1] remaining members to acquire global barrier 2023-07-14 08:14:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:47,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:47,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:47,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:47,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 08:14:47,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32a4b41b[Count = 0] remaining members to acquire global barrier 2023-07-14 08:14:47,124 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 08:14:47,124 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,128 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,128 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,128 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:47,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:47,129 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:47,129 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. started... 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:47,129 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:14:47,129 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,130 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8230ae20414d960a2b20ca772e9a8ed9 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 08:14:47,130 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:14:47,130 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:14:47,130 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,130 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:14:47,132 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:47,132 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. started... 2023-07-14 08:14:47,132 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 835871a74bf9f4aac6131ec6b1b8a3f0 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 08:14:47,140 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:47,140 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:47,140 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:47,159 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:47,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:47,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:47,161 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:14:47,215 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714c75caf21bf0243e9bc00e9a5f29a6ee7 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714c75caf21bf0243e9bc00e9a5f29a6ee7 2023-07-14 08:14:47,218 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071402cdf8116a584bd9871d60c034968c79 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071402cdf8116a584bd9871d60c034968c79 2023-07-14 08:14:47,301 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/.tmp/cf/9eb81c3b676b4a40bf47da0d5f99c34d 2023-07-14 08:14:47,309 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/.tmp/cf/a19867b92c494e958df0690c98448034 2023-07-14 08:14:47,318 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/.tmp/cf/a19867b92c494e958df0690c98448034 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf/a19867b92c494e958df0690c98448034 2023-07-14 08:14:47,322 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/.tmp/cf/9eb81c3b676b4a40bf47da0d5f99c34d as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf/9eb81c3b676b4a40bf47da0d5f99c34d 2023-07-14 08:14:47,324 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf/a19867b92c494e958df0690c98448034, entries=45, sequenceid=6, filesize=12.7 K 2023-07-14 08:14:47,327 INFO [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8230ae20414d960a2b20ca772e9a8ed9 in 198ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:47,327 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 08:14:47,328 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8230ae20414d960a2b20ca772e9a8ed9: 2023-07-14 08:14:47,329 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,333 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:47,333 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf/a19867b92c494e958df0690c98448034] hfiles 2023-07-14 08:14:47,333 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf/a19867b92c494e958df0690c98448034 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,334 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf/9eb81c3b676b4a40bf47da0d5f99c34d, entries=5, sequenceid=6, filesize=5.8 K 2023-07-14 08:14:47,340 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 835871a74bf9f4aac6131ec6b1b8a3f0 in 208ms, sequenceid=6, compaction requested=false 2023-07-14 08:14:47,342 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 835871a74bf9f4aac6131ec6b1b8a3f0: 2023-07-14 08:14:47,342 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,342 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:14:47,342 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf/9eb81c3b676b4a40bf47da0d5f99c34d] hfiles 2023-07-14 08:14:47,342 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf/9eb81c3b676b4a40bf47da0d5f99c34d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,361 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:47,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:47,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:47,363 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:14:47,435 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. completed. 2023-07-14 08:14:47,435 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:14:47,435 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:47,435 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:47,435 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,436 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:47,436 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:14:47,438 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,438 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:47,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:47,439 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:47,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:47,439 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:47,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:47,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:47,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:14:47,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 08:14:47,464 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. completed. 2023-07-14 08:14:47,464 DEBUG [rs(jenkins-hbase9.apache.org,38267,1689322343329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:14:47,464 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:14:47,464 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:14:47,464 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,464 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 08:14:47,464 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:14:47,466 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,466 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 08:14:47,466 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:47,466 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 08:14:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:47,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:47,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,38267,1689322343329': 2023-07-14 08:14:47,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 08:14:47,474 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 08:14:47,474 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:14:47,474 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:14:47,474 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,474 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:14:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:14:47,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,477 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:47,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:47,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:47,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:14:47,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,479 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,480 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:14:47,480 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:14:47,485 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,485 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,486 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,491 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:47,491 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:47,491 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:47,491 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:14:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:47,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:47,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:47,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:14:47,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:47,493 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,491 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,494 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-14 08:14:47,491 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:14:47,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:47,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:14:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:14:47,494 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:14:47,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:47,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:14:47,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:47,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:14:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:47,495 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,496 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:14:47,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071402cdf8116a584bd9871d60c034968c79, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714c75caf21bf0243e9bc00e9a5f29a6ee7] mob files 2023-07-14 08:14:47,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071402cdf8116a584bd9871d60c034968c79 2023-07-14 08:14:47,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714c75caf21bf0243e9bc00e9a5f29a6ee7 2023-07-14 08:14:47,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,663 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:47,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:47,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:14:47,666 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 08:14:47,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 08:14:47,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,784 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:47,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689322487058Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689322487622 (+564 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689322487622Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689322487622Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689322487670 (+48 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689322487686 (+16 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689322487784 (+98 ms) 2023-07-14 08:14:47,791 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 08:14:47,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 732 msec 2023-07-14 08:14:48,166 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:14:48,169 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:14:48,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 08:14:48,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:14:48,170 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170 2023-07-14 08:14:48,170 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43813, tgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170, rawTgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:14:48,241 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:14:48,241 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_371077227_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:48,241 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 08:14:48,287 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:14:48,397 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:48,398 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:48,398 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:48,399 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,632 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-159458031888111509.jar 2023-07-14 08:14:49,633 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,634 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,734 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-4199018345681650265.jar 2023-07-14 08:14:49,735 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,736 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,736 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,737 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,737 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,737 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:14:49,738 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:14:49,738 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:14:49,739 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:14:49,740 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:14:49,740 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:14:49,741 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:14:49,741 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:14:49,742 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:14:49,742 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:14:49,743 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:14:49,744 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:49,744 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:49,745 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:49,745 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:49,745 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:14:49,746 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:49,747 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:14:50,982 WARN [DataStreamer for file /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689322353275_0006/libjars/htrace-core4-4.2.0-incubating.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-14 08:14:51,464 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:14:51,471 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 08:14:51,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:51,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:14:52,021 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0006_000001 (auth:SIMPLE) 2023-07-14 08:14:58,685 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0006_000001 (auth:SIMPLE) 2023-07-14 08:15:01,904 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:15:01,906 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:15:01,922 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:15:01,922 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:15:01,923 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:15:01,923 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:15:01,923 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 08:15:01,923 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 08:15:01,924 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:15:01,924 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 08:15:01,924 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322488170/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 08:15:01,932 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 08:15:01,932 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 08:15:01,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:01,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 08:15:01,938 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322501938"}]},"ts":"1689322501938"} 2023-07-14 08:15:01,942 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 08:15:01,955 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 08:15:01,955 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, UNASSIGN}] 2023-07-14 08:15:01,957 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, UNASSIGN 2023-07-14 08:15:01,958 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, UNASSIGN 2023-07-14 08:15:01,958 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=835871a74bf9f4aac6131ec6b1b8a3f0, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:01,958 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8230ae20414d960a2b20ca772e9a8ed9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:01,958 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322501958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322501958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322501958"}]},"ts":"1689322501958"} 2023-07-14 08:15:01,958 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322501958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322501958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322501958"}]},"ts":"1689322501958"} 2023-07-14 08:15:01,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 835871a74bf9f4aac6131ec6b1b8a3f0, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:15:01,960 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 8230ae20414d960a2b20ca772e9a8ed9, server=jenkins-hbase9.apache.org,38267,1689322343329}] 2023-07-14 08:15:02,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 08:15:02,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:15:02,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 835871a74bf9f4aac6131ec6b1b8a3f0, disabling compactions & flushes 2023-07-14 08:15:02,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:15:02,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:15:02,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. after waiting 0 ms 2023-07-14 08:15:02,112 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:15:02,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:15:02,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8230ae20414d960a2b20ca772e9a8ed9, disabling compactions & flushes 2023-07-14 08:15:02,113 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:15:02,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:15:02,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. after waiting 0 ms 2023-07-14 08:15:02,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:15:02,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:02,132 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:02,134 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9. 2023-07-14 08:15:02,134 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8230ae20414d960a2b20ca772e9a8ed9: 2023-07-14 08:15:02,141 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:15:02,150 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8230ae20414d960a2b20ca772e9a8ed9, regionState=CLOSED 2023-07-14 08:15:02,150 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322502149"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322502149"}]},"ts":"1689322502149"} 2023-07-14 08:15:02,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 08:15:02,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 8230ae20414d960a2b20ca772e9a8ed9, server=jenkins-hbase9.apache.org,38267,1689322343329 in 191 msec 2023-07-14 08:15:02,156 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8230ae20414d960a2b20ca772e9a8ed9, UNASSIGN in 199 msec 2023-07-14 08:15:02,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:02,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:02,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0. 2023-07-14 08:15:02,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 835871a74bf9f4aac6131ec6b1b8a3f0: 2023-07-14 08:15:02,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:15:02,180 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=835871a74bf9f4aac6131ec6b1b8a3f0, regionState=CLOSED 2023-07-14 08:15:02,180 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689322502180"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322502180"}]},"ts":"1689322502180"} 2023-07-14 08:15:02,184 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 08:15:02,185 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 835871a74bf9f4aac6131ec6b1b8a3f0, server=jenkins-hbase9.apache.org,39577,1689322343153 in 223 msec 2023-07-14 08:15:02,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-14 08:15:02,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=835871a74bf9f4aac6131ec6b1b8a3f0, UNASSIGN in 230 msec 2023-07-14 08:15:02,189 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322502189"}]},"ts":"1689322502189"} 2023-07-14 08:15:02,193 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 08:15:02,202 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 08:15:02,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 270 msec 2023-07-14 08:15:02,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 08:15:02,240 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 08:15:02,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,248 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,250 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,257 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,265 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:15:02,265 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:15:02,269 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/recovered.edits] 2023-07-14 08:15:02,269 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/recovered.edits] 2023-07-14 08:15:02,275 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf/a19867b92c494e958df0690c98448034 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/cf/a19867b92c494e958df0690c98448034 2023-07-14 08:15:02,277 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf/9eb81c3b676b4a40bf47da0d5f99c34d to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/cf/9eb81c3b676b4a40bf47da0d5f99c34d 2023-07-14 08:15:02,279 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9/recovered.edits/9.seqid 2023-07-14 08:15:02,281 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/8230ae20414d960a2b20ca772e9a8ed9 2023-07-14 08:15:02,287 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,291 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,287 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,287 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 08:15:02,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 08:15:02,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 08:15:02,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 08:15:02,293 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0/recovered.edits/9.seqid 2023-07-14 08:15:02,301 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,301 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:02,301 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,301 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,301 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:02,301 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:02,302 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,302 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:02,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 08:15:02,303 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testEmptyExportFileSystemState/835871a74bf9f4aac6131ec6b1b8a3f0 2023-07-14 08:15:02,304 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 08:15:02,304 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 08:15:02,306 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-14 08:15:02,311 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071402cdf8116a584bd9871d60c034968c79 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023071402cdf8116a584bd9871d60c034968c79 2023-07-14 08:15:02,313 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714c75caf21bf0243e9bc00e9a5f29a6ee7 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230714c75caf21bf0243e9bc00e9a5f29a6ee7 2023-07-14 08:15:02,313 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-14 08:15:02,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,320 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 08:15:02,322 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 08:15:02,323 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,323 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 08:15:02,323 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322502323"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:02,324 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322502323"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:02,334 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:15:02,334 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 835871a74bf9f4aac6131ec6b1b8a3f0, NAME => 'testtb-testEmptyExportFileSystemState,,1689322483943.835871a74bf9f4aac6131ec6b1b8a3f0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8230ae20414d960a2b20ca772e9a8ed9, NAME => 'testtb-testEmptyExportFileSystemState,1,1689322483943.8230ae20414d960a2b20ca772e9a8ed9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:15:02,335 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 08:15:02,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322502335"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:02,344 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 08:15:02,349 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 08:15:02,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 108 msec 2023-07-14 08:15:02,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 08:15:02,406 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 08:15:02,413 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 08:15:02,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 08:15:02,416 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 08:15:02,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 08:15:02,453 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 754) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_67838201_1 at /127.0.0.1:52104 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:45654 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4918 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_67838201_1 at /127.0.0.1:52758 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1ff3833c-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1154669656) connection to jenkins-hbase9.apache.org/172.31.2.10:39647 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:48074 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_196848995_17 at /127.0.0.1:56056 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1271 (was 1178) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 186), AvailableMemoryMB=1767 (was 1305) - AvailableMemoryMB LEAK? - 2023-07-14 08:15:02,453 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-14 08:15:02,485 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=1271, ProcessCount=184, AvailableMemoryMB=1765 2023-07-14 08:15:02,485 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-14 08:15:02,487 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-14 08:15:02,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:02,493 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 08:15:02,495 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 08:15:02,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:15:02,497 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 08:15:02,500 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:02,500 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,500 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 empty. 2023-07-14 08:15:02,500 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 empty. 2023-07-14 08:15:02,501 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,501 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:02,501 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 08:15:02,521 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 08:15:02,526 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e8c824bc1c6f727c224a181cabd4e138, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:15:02,527 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7d693e9ce495165e6a41c070d93b1fd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp 2023-07-14 08:15:02,583 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:15:02,584 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e8c824bc1c6f727c224a181cabd4e138, disabling compactions & flushes 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 7d693e9ce495165e6a41c070d93b1fd9, disabling compactions & flushes 2023-07-14 08:15:02,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:02,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. after waiting 0 ms 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. after waiting 0 ms 2023-07-14 08:15:02,588 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:02,588 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:02,589 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:02,589 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 7d693e9ce495165e6a41c070d93b1fd9: 2023-07-14 08:15:02,589 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e8c824bc1c6f727c224a181cabd4e138: 2023-07-14 08:15:02,594 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 08:15:02,596 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322502596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322502596"}]},"ts":"1689322502596"} 2023-07-14 08:15:02,596 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322502596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322502596"}]},"ts":"1689322502596"} 2023-07-14 08:15:02,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:15:02,601 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 08:15:02,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 08:15:02,604 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322502604"}]},"ts":"1689322502604"} 2023-07-14 08:15:02,606 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 08:15:02,617 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 08:15:02,618 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 08:15:02,618 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 08:15:02,618 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 08:15:02,618 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 08:15:02,619 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, ASSIGN}] 2023-07-14 08:15:02,626 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, ASSIGN 2023-07-14 08:15:02,626 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, ASSIGN 2023-07-14 08:15:02,627 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,39577,1689322343153; forceNewPlan=false, retain=false 2023-07-14 08:15:02,627 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,44291,1689322343258; forceNewPlan=false, retain=false 2023-07-14 08:15:02,777 INFO [jenkins-hbase9:37597] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 08:15:02,781 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e8c824bc1c6f727c224a181cabd4e138, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:02,782 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322502781"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322502781"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322502781"}]},"ts":"1689322502781"} 2023-07-14 08:15:02,782 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7d693e9ce495165e6a41c070d93b1fd9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:02,782 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322502782"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322502782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322502782"}]},"ts":"1689322502782"} 2023-07-14 08:15:02,787 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure e8c824bc1c6f727c224a181cabd4e138, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:15:02,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 7d693e9ce495165e6a41c070d93b1fd9, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:15:02,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:15:02,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:02,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d693e9ce495165e6a41c070d93b1fd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 08:15:02,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. service=AccessControlService 2023-07-14 08:15:02,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:15:02,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:15:02,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,953 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:02,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8c824bc1c6f727c224a181cabd4e138, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 08:15:02,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. service=AccessControlService 2023-07-14 08:15:02,954 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 08:15:02,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:02,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 08:15:02,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:02,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:02,974 INFO [StoreOpener-7d693e9ce495165e6a41c070d93b1fd9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,977 DEBUG [StoreOpener-7d693e9ce495165e6a41c070d93b1fd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf 2023-07-14 08:15:02,977 DEBUG [StoreOpener-7d693e9ce495165e6a41c070d93b1fd9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf 2023-07-14 08:15:02,977 INFO [StoreOpener-7d693e9ce495165e6a41c070d93b1fd9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d693e9ce495165e6a41c070d93b1fd9 columnFamilyName cf 2023-07-14 08:15:02,987 INFO [StoreOpener-7d693e9ce495165e6a41c070d93b1fd9-1] regionserver.HStore(310): Store=7d693e9ce495165e6a41c070d93b1fd9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:15:02,990 INFO [StoreOpener-e8c824bc1c6f727c224a181cabd4e138-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:02,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,992 DEBUG [StoreOpener-e8c824bc1c6f727c224a181cabd4e138-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf 2023-07-14 08:15:02,992 DEBUG [StoreOpener-e8c824bc1c6f727c224a181cabd4e138-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf 2023-07-14 08:15:02,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:02,995 INFO [StoreOpener-e8c824bc1c6f727c224a181cabd4e138-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8c824bc1c6f727c224a181cabd4e138 columnFamilyName cf 2023-07-14 08:15:02,998 INFO [StoreOpener-e8c824bc1c6f727c224a181cabd4e138-1] regionserver.HStore(310): Store=e8c824bc1c6f727c224a181cabd4e138/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 08:15:03,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:15:03,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:03,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:03,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 7d693e9ce495165e6a41c070d93b1fd9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63807463, jitterRate=-0.049194708466529846}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:15:03,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 7d693e9ce495165e6a41c070d93b1fd9: 2023-07-14 08:15:03,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9., pid=109, masterSystemTime=1689322502941 2023-07-14 08:15:03,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:03,013 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7d693e9ce495165e6a41c070d93b1fd9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,013 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322503013"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322503013"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322503013"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322503013"}]},"ts":"1689322503013"} 2023-07-14 08:15:03,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:03,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:03,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-14 08:15:03,019 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 7d693e9ce495165e6a41c070d93b1fd9, server=jenkins-hbase9.apache.org,39577,1689322343153 in 227 msec 2023-07-14 08:15:03,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, ASSIGN in 400 msec 2023-07-14 08:15:03,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 08:15:03,029 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e8c824bc1c6f727c224a181cabd4e138; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64493611, jitterRate=-0.038970306515693665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 08:15:03,029 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e8c824bc1c6f727c224a181cabd4e138: 2023-07-14 08:15:03,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138., pid=108, masterSystemTime=1689322502940 2023-07-14 08:15:03,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:03,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:03,037 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e8c824bc1c6f727c224a181cabd4e138, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,038 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322503037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689322503037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689322503037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689322503037"}]},"ts":"1689322503037"} 2023-07-14 08:15:03,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-14 08:15:03,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure e8c824bc1c6f727c224a181cabd4e138, server=jenkins-hbase9.apache.org,44291,1689322343258 in 252 msec 2023-07-14 08:15:03,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-14 08:15:03,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, ASSIGN in 422 msec 2023-07-14 08:15:03,044 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 08:15:03,044 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322503044"}]},"ts":"1689322503044"} 2023-07-14 08:15:03,046 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 08:15:03,050 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 08:15:03,050 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 08:15:03,053 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 08:15:03,054 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:03,054 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:03,055 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:03,058 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:03,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:15:03,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:15:03,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:15:03,060 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 08:15:03,062 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 571 msec 2023-07-14 08:15:03,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 08:15:03,100 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 08:15:03,108 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,108 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:03,110 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:15:03,130 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:15:03,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322503131 (current time:1689322503131). 2023-07-14 08:15:03,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:15:03,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x1b6c7f93 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:15:03,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ff1f27d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:15:03,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:15:03,157 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46474, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:15:03,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b6c7f93 to 127.0.0.1:53917 2023-07-14 08:15:03,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:03,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x70cd4e5a to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:15:03,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8252737, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:15:03,169 DEBUG [hconnection-0x68274e54-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:15:03,170 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46476, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:15:03,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70cd4e5a to 127.0.0.1:53917 2023-07-14 08:15:03,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:03,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 08:15:03,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:15:03,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:15:03,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:15:03,182 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:15:03,183 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689323103183 2023-07-14 08:15:03,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:15:03,184 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,184 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:15:03,186 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:15:03,187 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:15:03,187 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:15:03,189 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-14 08:15:03,191 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:15:03,192 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689323103192 2023-07-14 08:15:03,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,213 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 08:15:03,213 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:03,215 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 08:15:03,215 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 08:15:03,281 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,281 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,282 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:03,282 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:03,282 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:03,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:03,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:03,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:03,282 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:03,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:03,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,284 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,284 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,284 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,284 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:15:03,286 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:15:03,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:15:03,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:15:03,287 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:15:03,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,290 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:15:03,290 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:03,305 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:15:03,306 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:15:03,306 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:15:03,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,310 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:15:03,310 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:03,310 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:15:03,311 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:03,311 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:15:03,312 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:15:03,312 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:15:03,314 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,314 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:15:03,314 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:15:03,314 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:15:03,314 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,314 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:15:03,315 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,315 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:03,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:03,316 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,316 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:15:03,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:03,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,317 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,318 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,318 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,318 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:15:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:03,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:15:03,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5bae77[Count = 1] remaining members to acquire global barrier 2023-07-14 08:15:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:03,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:03,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:15:03,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c5bae77[Count = 0] remaining members to acquire global barrier 2023-07-14 08:15:03,322 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 08:15:03,322 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:15:03,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:15:03,323 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:15:03,323 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. started... 2023-07-14 08:15:03,323 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:15:03,324 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:15:03,324 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. started... 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:15:03,324 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8c824bc1c6f727c224a181cabd4e138: 2023-07-14 08:15:03,323 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d693e9ce495165e6a41c070d93b1fd9: 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:15:03,325 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 08:15:03,326 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,326 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,326 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:15:03,328 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:15:03,328 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:03,328 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:15:03,418 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. completed. 2023-07-14 08:15:03,418 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:03,418 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:15:03,418 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:15:03,418 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,419 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:15:03,419 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:15:03,420 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. completed. 2023-07-14 08:15:03,420 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:03,420 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:15:03,421 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:03,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:03,423 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:03,423 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:15:03,424 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:03,424 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:15:03,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:03,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:15:03,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 08:15:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:03,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:03,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:15:03,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 08:15:03,457 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 08:15:03,457 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:15:03,457 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:15:03,457 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,457 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:15:03,459 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,459 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,459 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,460 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:03,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,459 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:03,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:03,460 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,462 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,463 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:03,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:03,465 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,466 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,466 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,459 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,469 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:03,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:03,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:03,472 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:03,472 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:03,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:03,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:03,472 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:03,472 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:03,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:03,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,474 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:03,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,476 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:15:03,476 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-14 08:15:03,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:03,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:03,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:03,487 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:15:03,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:15:03,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:15:03,490 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:15:03,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 08:15:03,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689322503184Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689322503512 (+328 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322503512Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322503513 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322503524 (+11 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689322503565 (+41 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689322503698 (+133 ms) 2023-07-14 08:15:03,707 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:15:03,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 522 msec 2023-07-14 08:15:03,790 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:15:03,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:15:03,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:15:03,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44291] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:15:03,801 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39577] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 08:15:03,805 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,805 DEBUG [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:03,805 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 08:15:03,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:15:03,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689322503820 (current time:1689322503820). 2023-07-14 08:15:03,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 08:15:03,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x23ab0c43 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:15:03,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@712ca38c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:15:03,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:15:03,839 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:15:03,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23ab0c43 to 127.0.0.1:53917 2023-07-14 08:15:03,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:03,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(139): Connect 0x422c32d7 to 127.0.0.1:53917 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 08:15:03,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@391ef7c5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 08:15:03,959 DEBUG [hconnection-0x2d3a03a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 08:15:03,965 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46488, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 08:15:03,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x422c32d7 to 127.0.0.1:53917 2023-07-14 08:15:03,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:03,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 08:15:03,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 08:15:03,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:15:03,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:15:03,987 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:15:03,988 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689323103988 2023-07-14 08:15:03,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 08:15:03,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:03,992 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 08:15:03,992 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 08:15:03,995 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 08:15:03,995 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:15:04,000 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-14 08:15:04,001 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:15:04,003 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689323104003 2023-07-14 08:15:04,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,055 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 08:15:04,055 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:04,057 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 08:15:04,057 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 08:15:04,086 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,087 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,088 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:04,088 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:04,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:04,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:04,088 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:04,088 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:04,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:04,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,091 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,091 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,092 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,092 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 08:15:04,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 08:15:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,092 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 08:15:04,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:15:04,094 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:15:04,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:15:04,094 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,094 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:04,094 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:15:04,094 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:04,094 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 08:15:04,096 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:15:04,097 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:15:04,097 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:15:04,096 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 08:15:04,097 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:15:04,097 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:15:04,096 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 08:15:04,097 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,38267,1689322343329' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:15:04,099 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 08:15:04,099 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 08:15:04,099 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 08:15:04,104 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,104 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,104 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:04,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:04,106 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,106 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,106 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,106 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:15:04,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:04,106 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:15:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,108 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,108 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,108 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 08:15:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:04,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,44291,1689322343258' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:15:04,110 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6691c336[Count = 1] remaining members to acquire global barrier 2023-07-14 08:15:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:04,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:04,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:04,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:04,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,39577,1689322343153' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 08:15:04,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6691c336[Count = 0] remaining members to acquire global barrier 2023-07-14 08:15:04,113 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 08:15:04,113 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,119 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:15:04,119 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:15:04,120 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,120 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,120 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 08:15:04,120 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:15:04,120 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,38267,1689322343329' in zk 2023-07-14 08:15:04,120 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,120 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 08:15:04,123 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:15:04,123 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:15:04,123 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:04,123 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 08:15:04,123 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. started... 2023-07-14 08:15:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:04,123 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 08:15:04,123 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. started... 2023-07-14 08:15:04,123 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e8c824bc1c6f727c224a181cabd4e138 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-14 08:15:04,123 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7d693e9ce495165e6a41c070d93b1fd9 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-14 08:15:04,125 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:15:04,125 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:04,125 DEBUG [member: 'jenkins-hbase9.apache.org,38267,1689322343329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:15:04,179 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230714ca0ce5c875904deb9f8bf798f4a64703 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ca0ce5c875904deb9f8bf798f4a64703 2023-07-14 08:15:04,179 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230714a5d9e6c8935f40909ccbddacc8b3073f to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5d9e6c8935f40909ccbddacc8b3073f 2023-07-14 08:15:04,211 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/.tmp/cf/97f89d50cdca4653aacb3c5c0ba9a452 2023-07-14 08:15:04,214 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/.tmp/cf/e2bee7c9d92a4138b7d3568bcf1c92aa 2023-07-14 08:15:04,217 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/.tmp/cf/97f89d50cdca4653aacb3c5c0ba9a452 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf/97f89d50cdca4653aacb3c5c0ba9a452 2023-07-14 08:15:04,220 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/.tmp/cf/e2bee7c9d92a4138b7d3568bcf1c92aa as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf/e2bee7c9d92a4138b7d3568bcf1c92aa 2023-07-14 08:15:04,223 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf/97f89d50cdca4653aacb3c5c0ba9a452, entries=44, sequenceid=6, filesize=12.8 K 2023-07-14 08:15:04,223 INFO [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 7d693e9ce495165e6a41c070d93b1fd9 in 100ms, sequenceid=6, compaction requested=false 2023-07-14 08:15:04,223 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 08:15:04,224 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7d693e9ce495165e6a41c070d93b1fd9: 2023-07-14 08:15:04,224 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,224 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:15:04,224 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf/97f89d50cdca4653aacb3c5c0ba9a452] hfiles 2023-07-14 08:15:04,224 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf/97f89d50cdca4653aacb3c5c0ba9a452 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,226 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf/e2bee7c9d92a4138b7d3568bcf1c92aa, entries=6, sequenceid=6, filesize=6.0 K 2023-07-14 08:15:04,234 INFO [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for e8c824bc1c6f727c224a181cabd4e138 in 111ms, sequenceid=6, compaction requested=false 2023-07-14 08:15:04,239 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8c824bc1c6f727c224a181cabd4e138: 2023-07-14 08:15:04,239 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,239 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 08:15:04,239 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf/e2bee7c9d92a4138b7d3568bcf1c92aa] hfiles 2023-07-14 08:15:04,239 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf/e2bee7c9d92a4138b7d3568bcf1c92aa for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,242 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. completed. 2023-07-14 08:15:04,242 DEBUG [rs(jenkins-hbase9.apache.org,39577,1689322343153)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:04,242 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:15:04,242 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:15:04,242 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,242 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:15:04,242 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,39577,1689322343153' in zk 2023-07-14 08:15:04,244 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:15:04,244 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:04,244 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,244 DEBUG [member: 'jenkins-hbase9.apache.org,39577,1689322343153' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:15:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:04,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:04,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:04,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,39577,1689322343153': 2023-07-14 08:15:04,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,39577,1689322343153' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 08:15:04,252 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. completed. 2023-07-14 08:15:04,252 DEBUG [rs(jenkins-hbase9.apache.org,44291,1689322343258)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:04,252 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 08:15:04,252 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 08:15:04,252 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,252 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 08:15:04,252 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,44291,1689322343258' in zk 2023-07-14 08:15:04,254 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,254 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 08:15:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:04,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:04,254 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:04,255 DEBUG [member: 'jenkins-hbase9.apache.org,44291,1689322343258' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 08:15:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:04,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,44291,1689322343258': 2023-07-14 08:15:04,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,44291,1689322343258' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 08:15:04,260 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 08:15:04,260 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 08:15:04,260 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 08:15:04,260 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,260 INFO [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:04,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,263 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:04,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:04,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 08:15:04,264 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:04,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 08:15:04,264 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,265 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 08:15:04,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,267 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 08:15:04,267 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,267 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,270 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,270 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,270 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,270 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,270 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:04,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:04,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:04,271 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 08:15:04,272 DEBUG [(jenkins-hbase9.apache.org,37597,1689322341574)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 08:15:04,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 08:15:04,272 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 08:15:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 08:15:04,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,272 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,272 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-14 08:15:04,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 08:15:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 08:15:04,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5d9e6c8935f40909ccbddacc8b3073f, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ca0ce5c875904deb9f8bf798f4a64703] mob files 2023-07-14 08:15:04,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5d9e6c8935f40909ccbddacc8b3073f 2023-07-14 08:15:04,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ca0ce5c875904deb9f8bf798f4a64703 2023-07-14 08:15:04,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,288 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,303 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:15:04,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:15:04,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 08:15:04,306 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 08:15:04,364 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,410 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 08:15:04,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,411 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,411 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689322503989Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689322504287 (+298 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689322504287Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689322504287Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689322504311 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689322504355 (+44 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689322504410 (+55 ms) 2023-07-14 08:15:04,415 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 08:15:04,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 423 msec 2023-07-14 08:15:04,606 DEBUG [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 08:15:04,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 08:15:04,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 08:15:04,607 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607 2023-07-14 08:15:04,608 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43813, tgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607, rawTgtDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607, srcFsUri=hdfs://localhost:43813, srcDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:15:04,634 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c 2023-07-14 08:15:04,635 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-663013728_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,635 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43813, inputRoot=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c, snapshotDir=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 08:15:04,662 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:04,725 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:04,725 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:04,726 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:04,726 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,913 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-4957296126395818146.jar 2023-07-14 08:15:05,914 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,914 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,987 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/hadoop-2247965957383010946.jar 2023-07-14 08:15:05,987 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,988 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,988 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,989 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,989 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,990 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 08:15:05,990 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 08:15:05,991 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 08:15:05,991 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 08:15:05,991 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 08:15:05,992 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 08:15:05,992 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 08:15:05,993 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 08:15:05,993 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 08:15:05,993 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 08:15:05,994 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 08:15:05,994 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:05,995 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:05,995 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:15:05,995 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:05,996 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 08:15:05,996 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:15:05,997 DEBUG [Listener at jenkins-hbase9.apache.org/33489] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 08:15:06,297 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0006_000001 (auth:SIMPLE) 2023-07-14 08:15:07,827 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:15:08,355 WARN [Listener at jenkins-hbase9.apache.org/33489] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 08:15:08,363 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 08:15:08,385 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-14 08:15:08,581 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:15:08,581 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 08:15:09,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:15,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:18,254 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689322353275_0007_000001 (auth:SIMPLE) 2023-07-14 08:15:23,734 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 08:15:23,734 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 08:15:23,745 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:23,745 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 08:15:23,747 INFO [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 08:15:23,747 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:23,747 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 08:15:23,748 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 08:15:23,748 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_196848995_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:23,748 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 08:15:23,748 DEBUG [Listener at jenkins-hbase9.apache.org/33489] snapshot.TestExportSnapshot(367): hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/export-test/export-1689322504607/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 08:15:23,757 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:23,757 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:23,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:23,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:23,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322523762"}]},"ts":"1689322523762"} 2023-07-14 08:15:23,763 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 08:15:23,765 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 08:15:23,765 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, UNASSIGN}] 2023-07-14 08:15:23,767 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, UNASSIGN 2023-07-14 08:15:23,768 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, UNASSIGN 2023-07-14 08:15:23,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e8c824bc1c6f727c224a181cabd4e138, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:23,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=7d693e9ce495165e6a41c070d93b1fd9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:23,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322523769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322523769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322523769"}]},"ts":"1689322523769"} 2023-07-14 08:15:23,769 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322523769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689322523769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689322523769"}]},"ts":"1689322523769"} 2023-07-14 08:15:23,770 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure e8c824bc1c6f727c224a181cabd4e138, server=jenkins-hbase9.apache.org,44291,1689322343258}] 2023-07-14 08:15:23,772 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 7d693e9ce495165e6a41c070d93b1fd9, server=jenkins-hbase9.apache.org,39577,1689322343153}] 2023-07-14 08:15:23,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:23,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:23,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e8c824bc1c6f727c224a181cabd4e138, disabling compactions & flushes 2023-07-14 08:15:23,923 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:23,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:23,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. after waiting 0 ms 2023-07-14 08:15:23,923 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:23,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:23,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 7d693e9ce495165e6a41c070d93b1fd9, disabling compactions & flushes 2023-07-14 08:15:23,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:23,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:23,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. after waiting 0 ms 2023-07-14 08:15:23,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:23,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:23,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:23,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:23,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:23,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138. 2023-07-14 08:15:23,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9. 2023-07-14 08:15:23,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 7d693e9ce495165e6a41c070d93b1fd9: 2023-07-14 08:15:23,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e8c824bc1c6f727c224a181cabd4e138: 2023-07-14 08:15:23,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:23,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e8c824bc1c6f727c224a181cabd4e138, regionState=CLOSED 2023-07-14 08:15:23,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322523984"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322523984"}]},"ts":"1689322523984"} 2023-07-14 08:15:23,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:23,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=7d693e9ce495165e6a41c070d93b1fd9, regionState=CLOSED 2023-07-14 08:15:23,986 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689322523986"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689322523986"}]},"ts":"1689322523986"} 2023-07-14 08:15:23,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-14 08:15:23,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure e8c824bc1c6f727c224a181cabd4e138, server=jenkins-hbase9.apache.org,44291,1689322343258 in 219 msec 2023-07-14 08:15:23,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-14 08:15:23,993 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 7d693e9ce495165e6a41c070d93b1fd9, server=jenkins-hbase9.apache.org,39577,1689322343153 in 218 msec 2023-07-14 08:15:23,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e8c824bc1c6f727c224a181cabd4e138, UNASSIGN in 227 msec 2023-07-14 08:15:23,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-14 08:15:23,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=7d693e9ce495165e6a41c070d93b1fd9, UNASSIGN in 228 msec 2023-07-14 08:15:23,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689322523996"}]},"ts":"1689322523996"} 2023-07-14 08:15:23,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 08:15:23,999 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 08:15:24,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 243 msec 2023-07-14 08:15:24,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 08:15:24,064 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 08:15:24,065 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,069 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,070 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,071 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38267] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,074 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,074 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,074 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,074 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 08:15:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 08:15:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 08:15:24,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 08:15:24,075 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:24,075 DEBUG [HFileArchiver-28] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,077 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:24,076 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 08:15:24,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 08:15:24,078 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/recovered.edits] 2023-07-14 08:15:24,078 DEBUG [HFileArchiver-28] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf, FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/recovered.edits] 2023-07-14 08:15:24,082 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf/e2bee7c9d92a4138b7d3568bcf1c92aa to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/cf/e2bee7c9d92a4138b7d3568bcf1c92aa 2023-07-14 08:15:24,082 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf/97f89d50cdca4653aacb3c5c0ba9a452 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/cf/97f89d50cdca4653aacb3c5c0ba9a452 2023-07-14 08:15:24,085 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138/recovered.edits/9.seqid 2023-07-14 08:15:24,086 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/recovered.edits/9.seqid to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9/recovered.edits/9.seqid 2023-07-14 08:15:24,086 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e8c824bc1c6f727c224a181cabd4e138 2023-07-14 08:15:24,089 DEBUG [HFileArchiver-28] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/7d693e9ce495165e6a41c070d93b1fd9 2023-07-14 08:15:24,089 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 08:15:24,090 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 08:15:24,091 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-14 08:15:24,095 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5d9e6c8935f40909ccbddacc8b3073f to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230714a5d9e6c8935f40909ccbddacc8b3073f 2023-07-14 08:15:24,097 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ca0ce5c875904deb9f8bf798f4a64703 to hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230714ca0ce5c875904deb9f8bf798f4a64703 2023-07-14 08:15:24,099 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-14 08:15:24,105 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,108 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 08:15:24,111 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 08:15:24,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 08:15:24,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322524113"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:24,113 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689322524113"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:24,115 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 08:15:24,115 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e8c824bc1c6f727c224a181cabd4e138, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689322502487.e8c824bc1c6f727c224a181cabd4e138.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7d693e9ce495165e6a41c070d93b1fd9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689322502487.7d693e9ce495165e6a41c070d93b1fd9.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 08:15:24,115 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 08:15:24,115 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689322524115"}]},"ts":"9223372036854775807"} 2023-07-14 08:15:24,116 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 08:15:24,130 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 65 msec 2023-07-14 08:15:24,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 08:15:24,179 INFO [Listener at jenkins-hbase9.apache.org/33489] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 08:15:24,187 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 08:15:24,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 08:15:24,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37597] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 08:15:24,249 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=758 (was 762), OpenFileDescriptor=897 (was 902), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1129 (was 1271), ProcessCount=184 (was 184), AvailableMemoryMB=1844 (was 1765) - AvailableMemoryMB LEAK? - 2023-07-14 08:15:24,249 WARN [Listener at jenkins-hbase9.apache.org/33489] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-14 08:15:24,249 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 08:15:24,323 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:24,467 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689322353275_0007_01_000001 is : 143 2023-07-14 08:15:29,578 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 08:15:38,532 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:52,656 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 08:15:52,656 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:52,767 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 08:15:52,778 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 08:15:52,780 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 08:15:52,802 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 08:15:52,906 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 08:15:52,906 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 08:15:52,906 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 08:15:52,906 INFO [Listener at jenkins-hbase9.apache.org/33489] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 08:15:52,907 DEBUG [Listener at jenkins-hbase9.apache.org/33489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0193df40 to 127.0.0.1:53917 2023-07-14 08:15:52,907 DEBUG [Listener at jenkins-hbase9.apache.org/33489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:52,907 DEBUG [Listener at jenkins-hbase9.apache.org/33489] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 08:15:52,907 DEBUG [Listener at jenkins-hbase9.apache.org/33489] util.JVMClusterUtil(257): Found active master hash=1245766031, stopped=false 2023-07-14 08:15:52,907 DEBUG [Listener at jenkins-hbase9.apache.org/33489] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:52,907 DEBUG [Listener at jenkins-hbase9.apache.org/33489] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 08:15:52,907 INFO [Listener at jenkins-hbase9.apache.org/33489] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:15:52,932 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:52,932 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:52,932 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:52,932 INFO [Listener at jenkins-hbase9.apache.org/33489] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 08:15:52,933 DEBUG [Listener at jenkins-hbase9.apache.org/33489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c51a5f4 to 127.0.0.1:53917 2023-07-14 08:15:52,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:52,932 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 08:15:52,933 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:15:52,933 DEBUG [Listener at jenkins-hbase9.apache.org/33489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:52,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:52,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:52,933 INFO [Listener at jenkins-hbase9.apache.org/33489] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,39577,1689322343153' ***** 2023-07-14 08:15:52,933 DEBUG [Listener at jenkins-hbase9.apache.org/33489] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:52,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 08:15:52,934 INFO [Listener at jenkins-hbase9.apache.org/33489] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 08:15:52,934 INFO [Listener at jenkins-hbase9.apache.org/33489] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,44291,1689322343258' ***** 2023-07-14 08:15:52,934 DEBUG [Listener at jenkins-hbase9.apache.org/33489] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:52,934 INFO [Listener at jenkins-hbase9.apache.org/33489] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 08:15:52,934 INFO [Listener at jenkins-hbase9.apache.org/33489] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38267,1689322343329' ***** 2023-07-14 08:15:52,934 DEBUG [Listener at jenkins-hbase9.apache.org/33489] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:52,934 INFO [Listener at jenkins-hbase9.apache.org/33489] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 08:15:52,934 INFO [RS:2;jenkins-hbase9:38267] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 08:15:52,934 INFO [RS:1;jenkins-hbase9:44291] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 08:15:52,934 INFO [RS:2;jenkins-hbase9:38267] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 08:15:52,935 INFO [RS:2;jenkins-hbase9:38267] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 08:15:52,935 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 08:15:52,935 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(3305): Received CLOSE for ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:15:52,935 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:52,935 DEBUG [RS:2;jenkins-hbase9:38267] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ecd2ede to 127.0.0.1:53917 2023-07-14 08:15:52,935 DEBUG [RS:2;jenkins-hbase9:38267] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:52,934 INFO [RS:0;jenkins-hbase9:39577] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 08:15:52,937 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:52,937 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 08:15:52,935 INFO [RS:1;jenkins-hbase9:44291] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 08:15:52,939 INFO [RS:1;jenkins-hbase9:44291] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 08:15:52,939 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(3305): Received CLOSE for 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:15:52,939 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:52,939 DEBUG [RS:1;jenkins-hbase9:44291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5aa8dcb4 to 127.0.0.1:53917 2023-07-14 08:15:52,939 DEBUG [RS:1;jenkins-hbase9:44291] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:52,937 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 08:15:52,937 INFO [RS:0;jenkins-hbase9:39577] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 08:15:52,940 INFO [RS:0;jenkins-hbase9:39577] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 08:15:52,940 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:52,940 DEBUG [RS:0;jenkins-hbase9:39577] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3abf3cc0 to 127.0.0.1:53917 2023-07-14 08:15:52,940 DEBUG [RS:0;jenkins-hbase9:39577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:52,940 INFO [RS:2;jenkins-hbase9:38267] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 08:15:52,940 INFO [RS:2;jenkins-hbase9:38267] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 08:15:52,940 INFO [RS:2;jenkins-hbase9:38267] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 08:15:52,940 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 08:15:52,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing ae7a8501ef028de2d71b7904f49b7239, disabling compactions & flushes 2023-07-14 08:15:52,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:15:52,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:15:52,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. after waiting 0 ms 2023-07-14 08:15:52,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:15:52,941 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 08:15:52,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing ae7a8501ef028de2d71b7904f49b7239 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 08:15:52,945 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1478): Online Regions={ae7a8501ef028de2d71b7904f49b7239=hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239., 1588230740=hbase:meta,,1.1588230740} 2023-07-14 08:15:52,947 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1504): Waiting on 1588230740, ae7a8501ef028de2d71b7904f49b7239 2023-07-14 08:15:52,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8e428c041cc6e3fda05976246c4a8d78, disabling compactions & flushes 2023-07-14 08:15:52,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:15:52,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:15:52,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. after waiting 0 ms 2023-07-14 08:15:52,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:15:52,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 8e428c041cc6e3fda05976246c4a8d78 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 08:15:52,948 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,39577,1689322343153; all regions closed. 2023-07-14 08:15:52,949 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 08:15:52,949 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 08:15:52,950 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1478): Online Regions={8e428c041cc6e3fda05976246c4a8d78=hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78.} 2023-07-14 08:15:52,950 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 08:15:52,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 08:15:52,950 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1504): Waiting on 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:15:52,951 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 08:15:52,951 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 08:15:52,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 08:15:53,021 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:53,025 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:53,038 DEBUG [RS:0;jenkins-hbase9:39577] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs 2023-07-14 08:15:53,038 INFO [RS:0;jenkins-hbase9:39577] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C39577%2C1689322343153:(num 1689322345873) 2023-07-14 08:15:53,038 DEBUG [RS:0;jenkins-hbase9:39577] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:53,038 INFO [RS:0;jenkins-hbase9:39577] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:53,038 INFO [RS:0;jenkins-hbase9:39577] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 08:15:53,038 INFO [RS:0;jenkins-hbase9:39577] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 08:15:53,039 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:53,039 INFO [RS:0;jenkins-hbase9:39577] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 08:15:53,039 INFO [RS:0;jenkins-hbase9:39577] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 08:15:53,039 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/.tmp/info/2ab5f3a028774265ab47b30584e2b7c4 2023-07-14 08:15:53,040 INFO [RS:0;jenkins-hbase9:39577] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:39577 2023-07-14 08:15:53,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/.tmp/l/c46c74050ac54a1fb4577ec4b5627a9a 2023-07-14 08:15:53,048 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:53,048 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:53,048 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:53,048 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:53,049 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:53,049 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,39577,1689322343153] 2023-07-14 08:15:53,052 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,39577,1689322343153; numProcessing=1 2023-07-14 08:15:53,054 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,39577,1689322343153 already deleted, retry=false 2023-07-14 08:15:53,054 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,39577,1689322343153 expired; onlineServers=2 2023-07-14 08:15:53,054 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,39577,1689322343153 2023-07-14 08:15:53,054 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:53,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c46c74050ac54a1fb4577ec4b5627a9a 2023-07-14 08:15:53,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/.tmp/l/c46c74050ac54a1fb4577ec4b5627a9a as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/l/c46c74050ac54a1fb4577ec4b5627a9a 2023-07-14 08:15:53,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/.tmp/info/adbab76f7c81492fa9244833339337cc 2023-07-14 08:15:53,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/.tmp/info/adbab76f7c81492fa9244833339337cc as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/info/adbab76f7c81492fa9244833339337cc 2023-07-14 08:15:53,079 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ab5f3a028774265ab47b30584e2b7c4 2023-07-14 08:15:53,081 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/info/adbab76f7c81492fa9244833339337cc, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 08:15:53,082 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8e428c041cc6e3fda05976246c4a8d78 in 135ms, sequenceid=6, compaction requested=false 2023-07-14 08:15:53,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c46c74050ac54a1fb4577ec4b5627a9a 2023-07-14 08:15:53,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/l/c46c74050ac54a1fb4577ec4b5627a9a, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 08:15:53,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for ae7a8501ef028de2d71b7904f49b7239 in 153ms, sequenceid=18, compaction requested=false 2023-07-14 08:15:53,135 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/.tmp/rep_barrier/87b4a92a006e4890b68a58d8e00d1cc1 2023-07-14 08:15:53,139 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87b4a92a006e4890b68a58d8e00d1cc1 2023-07-14 08:15:53,141 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/acl/ae7a8501ef028de2d71b7904f49b7239/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 08:15:53,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/namespace/8e428c041cc6e3fda05976246c4a8d78/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 08:15:53,142 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:53,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:15:53,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for ae7a8501ef028de2d71b7904f49b7239: 2023-07-14 08:15:53,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689322347950.ae7a8501ef028de2d71b7904f49b7239. 2023-07-14 08:15:53,147 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:53,154 DEBUG [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 08:15:53,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:15:53,154 DEBUG [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1504): Waiting on 8e428c041cc6e3fda05976246c4a8d78 2023-07-14 08:15:53,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8e428c041cc6e3fda05976246c4a8d78: 2023-07-14 08:15:53,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689322346645.8e428c041cc6e3fda05976246c4a8d78. 2023-07-14 08:15:53,162 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,162 INFO [RS:0;jenkins-hbase9:39577] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,39577,1689322343153; zookeeper connection closed. 2023-07-14 08:15:53,163 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:39577-0x10162d6046a0001, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,168 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@70c54e4d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@70c54e4d 2023-07-14 08:15:53,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/.tmp/table/f57e8f33d32d46aeb0f753db1b23c1d8 2023-07-14 08:15:53,185 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f57e8f33d32d46aeb0f753db1b23c1d8 2023-07-14 08:15:53,186 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/.tmp/info/2ab5f3a028774265ab47b30584e2b7c4 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/info/2ab5f3a028774265ab47b30584e2b7c4 2023-07-14 08:15:53,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ab5f3a028774265ab47b30584e2b7c4 2023-07-14 08:15:53,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/info/2ab5f3a028774265ab47b30584e2b7c4, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 08:15:53,193 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/.tmp/rep_barrier/87b4a92a006e4890b68a58d8e00d1cc1 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/rep_barrier/87b4a92a006e4890b68a58d8e00d1cc1 2023-07-14 08:15:53,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87b4a92a006e4890b68a58d8e00d1cc1 2023-07-14 08:15:53,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/rep_barrier/87b4a92a006e4890b68a58d8e00d1cc1, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 08:15:53,200 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/.tmp/table/f57e8f33d32d46aeb0f753db1b23c1d8 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/table/f57e8f33d32d46aeb0f753db1b23c1d8 2023-07-14 08:15:53,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f57e8f33d32d46aeb0f753db1b23c1d8 2023-07-14 08:15:53,210 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/table/f57e8f33d32d46aeb0f753db1b23c1d8, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 08:15:53,212 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 259ms, sequenceid=131, compaction requested=false 2023-07-14 08:15:53,278 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 08:15:53,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 08:15:53,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 08:15:53,280 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 08:15:53,280 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 08:15:53,281 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 08:15:53,354 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,38267,1689322343329; all regions closed. 2023-07-14 08:15:53,355 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,44291,1689322343258; all regions closed. 2023-07-14 08:15:53,364 DEBUG [RS:1;jenkins-hbase9:44291] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs 2023-07-14 08:15:53,364 INFO [RS:1;jenkins-hbase9:44291] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C44291%2C1689322343258:(num 1689322345861) 2023-07-14 08:15:53,364 DEBUG [RS:1;jenkins-hbase9:44291] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:53,364 INFO [RS:1;jenkins-hbase9:44291] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:53,364 INFO [RS:1;jenkins-hbase9:44291] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 08:15:53,365 INFO [RS:1;jenkins-hbase9:44291] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 08:15:53,365 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:53,365 DEBUG [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs 2023-07-14 08:15:53,365 INFO [RS:1;jenkins-hbase9:44291] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 08:15:53,365 INFO [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C38267%2C1689322343329.meta:.meta(num 1689322346263) 2023-07-14 08:15:53,365 INFO [RS:1;jenkins-hbase9:44291] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 08:15:53,366 INFO [RS:1;jenkins-hbase9:44291] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:44291 2023-07-14 08:15:53,369 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:53,369 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:53,371 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,44291,1689322343258 2023-07-14 08:15:53,371 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,44291,1689322343258] 2023-07-14 08:15:53,371 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,44291,1689322343258; numProcessing=2 2023-07-14 08:15:53,373 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,44291,1689322343258 already deleted, retry=false 2023-07-14 08:15:53,373 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,44291,1689322343258 expired; onlineServers=1 2023-07-14 08:15:53,375 DEBUG [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/oldWALs 2023-07-14 08:15:53,375 INFO [RS:2;jenkins-hbase9:38267] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C38267%2C1689322343329:(num 1689322345880) 2023-07-14 08:15:53,375 DEBUG [RS:2;jenkins-hbase9:38267] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:53,375 INFO [RS:2;jenkins-hbase9:38267] regionserver.LeaseManager(133): Closed leases 2023-07-14 08:15:53,376 INFO [RS:2;jenkins-hbase9:38267] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 08:15:53,376 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:53,377 INFO [RS:2;jenkins-hbase9:38267] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38267 2023-07-14 08:15:53,380 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 08:15:53,380 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,38267,1689322343329 2023-07-14 08:15:53,381 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,38267,1689322343329] 2023-07-14 08:15:53,381 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,38267,1689322343329; numProcessing=3 2023-07-14 08:15:53,382 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,38267,1689322343329 already deleted, retry=false 2023-07-14 08:15:53,382 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,38267,1689322343329 expired; onlineServers=0 2023-07-14 08:15:53,382 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,37597,1689322341574' ***** 2023-07-14 08:15:53,382 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 08:15:53,382 DEBUG [M:0;jenkins-hbase9:37597] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7debb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 08:15:53,382 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,37597,1689322341574 2023-07-14 08:15:53,383 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,37597,1689322341574; all regions closed. 2023-07-14 08:15:53,383 DEBUG [M:0;jenkins-hbase9:37597] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 08:15:53,383 DEBUG [M:0;jenkins-hbase9:37597] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 08:15:53,383 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 08:15:53,383 DEBUG [M:0;jenkins-hbase9:37597] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 08:15:53,383 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689322345274] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689322345274,5,FailOnTimeoutGroup] 2023-07-14 08:15:53,383 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689322345280] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689322345280,5,FailOnTimeoutGroup] 2023-07-14 08:15:53,383 INFO [M:0;jenkins-hbase9:37597] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 08:15:53,383 INFO [M:0;jenkins-hbase9:37597] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 08:15:53,383 INFO [M:0;jenkins-hbase9:37597] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 08:15:53,383 DEBUG [M:0;jenkins-hbase9:37597] master.HMaster(1512): Stopping service threads 2023-07-14 08:15:53,383 INFO [M:0;jenkins-hbase9:37597] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 08:15:53,384 ERROR [M:0;jenkins-hbase9:37597] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-27,5,PEWorkerGroup] Thread[HFileArchiver-28,5,PEWorkerGroup] 2023-07-14 08:15:53,384 INFO [M:0;jenkins-hbase9:37597] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 08:15:53,384 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 08:15:53,386 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 08:15:53,386 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 08:15:53,386 DEBUG [M:0;jenkins-hbase9:37597] zookeeper.ZKUtil(398): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 08:15:53,386 WARN [M:0;jenkins-hbase9:37597] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 08:15:53,386 INFO [M:0;jenkins-hbase9:37597] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 08:15:53,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 08:15:53,386 INFO [M:0;jenkins-hbase9:37597] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 08:15:53,387 DEBUG [M:0;jenkins-hbase9:37597] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 08:15:53,387 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:53,387 DEBUG [M:0;jenkins-hbase9:37597] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:53,387 DEBUG [M:0;jenkins-hbase9:37597] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 08:15:53,387 DEBUG [M:0;jenkins-hbase9:37597] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:53,387 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.92 KB heapSize=452.17 KB 2023-07-14 08:15:53,438 INFO [M:0;jenkins-hbase9:37597] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.92 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/58cec0d1a71441f796a8df59b242a4e0 2023-07-14 08:15:53,445 INFO [M:0;jenkins-hbase9:37597] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58cec0d1a71441f796a8df59b242a4e0 2023-07-14 08:15:53,446 DEBUG [M:0;jenkins-hbase9:37597] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/58cec0d1a71441f796a8df59b242a4e0 as hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/58cec0d1a71441f796a8df59b242a4e0 2023-07-14 08:15:53,450 INFO [M:0;jenkins-hbase9:37597] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58cec0d1a71441f796a8df59b242a4e0 2023-07-14 08:15:53,451 INFO [M:0;jenkins-hbase9:37597] regionserver.HStore(1080): Added hdfs://localhost:43813/user/jenkins/test-data/2952325a-68eb-7b51-c612-bd950fa2570c/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/58cec0d1a71441f796a8df59b242a4e0, entries=119, sequenceid=899, filesize=28.7 K 2023-07-14 08:15:53,453 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegion(2948): Finished flush of dataSize ~375.92 KB/384938, heapSize ~452.16 KB/463008, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 66ms, sequenceid=899, compaction requested=false 2023-07-14 08:15:53,466 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 08:15:53,466 DEBUG [M:0;jenkins-hbase9:37597] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 08:15:53,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,473 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:44291-0x10162d6046a0002, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,477 INFO [RS:1;jenkins-hbase9:44291] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,44291,1689322343258; zookeeper connection closed. 2023-07-14 08:15:53,482 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 08:15:53,482 INFO [M:0;jenkins-hbase9:37597] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 08:15:53,490 INFO [M:0;jenkins-hbase9:37597] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:37597 2023-07-14 08:15:53,490 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5c3e7806] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5c3e7806 2023-07-14 08:15:53,492 DEBUG [M:0;jenkins-hbase9:37597] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,37597,1689322341574 already deleted, retry=false 2023-07-14 08:15:53,577 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,577 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): regionserver:38267-0x10162d6046a0003, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,577 INFO [RS:2;jenkins-hbase9:38267] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38267,1689322343329; zookeeper connection closed. 2023-07-14 08:15:53,578 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@17fcb232] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@17fcb232 2023-07-14 08:15:53,578 INFO [Listener at jenkins-hbase9.apache.org/33489] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 08:15:53,677 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,677 INFO [M:0;jenkins-hbase9:37597] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,37597,1689322341574; zookeeper connection closed. 2023-07-14 08:15:53,678 DEBUG [Listener at localhost/33647-EventThread] zookeeper.ZKWatcher(600): master:37597-0x10162d6046a0000, quorum=127.0.0.1:53917, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 08:15:53,680 WARN [Listener at jenkins-hbase9.apache.org/33489] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 08:15:53,691 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:53,797 WARN [BP-2015387840-172.31.2.10-1689322336401 heartbeating to localhost/127.0.0.1:43813] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 08:15:53,797 WARN [BP-2015387840-172.31.2.10-1689322336401 heartbeating to localhost/127.0.0.1:43813] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2015387840-172.31.2.10-1689322336401 (Datanode Uuid a9b348cb-b67d-4265-85d8-ea1d38f345d5) service to localhost/127.0.0.1:43813 2023-07-14 08:15:53,799 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data5/current/BP-2015387840-172.31.2.10-1689322336401] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:53,800 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data6/current/BP-2015387840-172.31.2.10-1689322336401] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:53,803 WARN [Listener at jenkins-hbase9.apache.org/33489] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 08:15:53,827 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:53,934 WARN [BP-2015387840-172.31.2.10-1689322336401 heartbeating to localhost/127.0.0.1:43813] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 08:15:53,934 WARN [BP-2015387840-172.31.2.10-1689322336401 heartbeating to localhost/127.0.0.1:43813] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2015387840-172.31.2.10-1689322336401 (Datanode Uuid 2092b08a-4e3c-40ff-bf15-c4a32182e65d) service to localhost/127.0.0.1:43813 2023-07-14 08:15:53,935 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data3/current/BP-2015387840-172.31.2.10-1689322336401] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:53,940 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data4/current/BP-2015387840-172.31.2.10-1689322336401] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:53,943 WARN [Listener at jenkins-hbase9.apache.org/33489] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 08:15:53,987 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:54,091 WARN [BP-2015387840-172.31.2.10-1689322336401 heartbeating to localhost/127.0.0.1:43813] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 08:15:54,091 WARN [BP-2015387840-172.31.2.10-1689322336401 heartbeating to localhost/127.0.0.1:43813] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2015387840-172.31.2.10-1689322336401 (Datanode Uuid 601b63cf-b350-4bf2-864d-da8cee31a82b) service to localhost/127.0.0.1:43813 2023-07-14 08:15:54,092 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data1/current/BP-2015387840-172.31.2.10-1689322336401] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:54,092 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8408298a-c4c1-a129-339e-506c3921a466/cluster_b65ae18d-77d7-552e-29cb-a045b23a76ed/dfs/data/data2/current/BP-2015387840-172.31.2.10-1689322336401] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 08:15:54,134 INFO [Listener at jenkins-hbase9.apache.org/33489] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 08:15:54,173 INFO [Listener at jenkins-hbase9.apache.org/33489] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 08:15:54,315 INFO [Listener at jenkins-hbase9.apache.org/33489] hbase.HBaseTestingUtility(1293): Minicluster is down